-- Logs begin at Wed 2022-08-10 10:21:28 UTC, end at Wed 2022-08-10 11:25:16 UTC. -- Aug 10 10:56:44.782919 dv-cinder-850618-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 10:56:44.790443 dv-cinder-850618-2-smb devstack@keystone.service[80414]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 10:56:44 2022] *** Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: nodename: dv-cinder-850618-2-smb Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: machine: x86_64 Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: clock source: unix Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: pcre jit disabled Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: detected number of CPU cores: 4 Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: current working directory: / Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: detected binary path: /usr/bin/uwsgi-core Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: your processes number limit is 47680 Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: your memory page size is 4096 bytes Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: detected max file descriptor number: 2048 Aug 10 10:56:44.792468 dv-cinder-850618-2-smb devstack@keystone.service[80414]: lock engine: pthread robust mutexes Aug 10 10:56:44.793478 dv-cinder-850618-2-smb devstack@keystone.service[80414]: thunder lock: enabled Aug 10 10:56:44.793478 dv-cinder-850618-2-smb devstack@keystone.service[80414]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 10:56:44.793478 dv-cinder-850618-2-smb devstack@keystone.service[80414]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 10:56:44.832584 dv-cinder-850618-2-smb devstack@keystone.service[80414]: Python main interpreter initialized at 0x55cf335059c0 Aug 10 10:56:44.832584 dv-cinder-850618-2-smb devstack@keystone.service[80414]: python threads support enabled Aug 10 10:56:44.832584 dv-cinder-850618-2-smb devstack@keystone.service[80414]: your server socket listen backlog is limited to 100 connections Aug 10 10:56:44.832584 dv-cinder-850618-2-smb devstack@keystone.service[80414]: your mercy for graceful operations on workers is 90 seconds Aug 10 10:56:44.833026 dv-cinder-850618-2-smb devstack@keystone.service[80414]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 10:56:44.833026 dv-cinder-850618-2-smb devstack@keystone.service[80414]: *** Operational MODE: preforking *** Aug 10 10:56:44.833344 dv-cinder-850618-2-smb devstack@keystone.service[80414]: *** uWSGI is running in multiple interpreter mode *** Aug 10 10:56:44.833344 dv-cinder-850618-2-smb devstack@keystone.service[80414]: spawned uWSGI master process (pid: 80414) Aug 10 10:56:44.833571 dv-cinder-850618-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 10:56:44.834635 dv-cinder-850618-2-smb devstack@keystone.service[80414]: spawned uWSGI worker 1 (pid: 80427, cores: 1) Aug 10 10:56:44.834635 dv-cinder-850618-2-smb devstack@keystone.service[80414]: spawned uWSGI worker 2 (pid: 80428, cores: 1) Aug 10 10:56:44.834635 dv-cinder-850618-2-smb devstack@keystone.service[80414]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 10:56:50.227517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:56:50.227517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: from cryptography.utils import int_from_bytes Aug 10 10:56:50.228266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:56:50.228266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: from cryptography.utils import int_from_bytes Aug 10 10:56:50.228701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:56:50.228701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: from cryptography.utils import int_from_bytes Aug 10 10:56:50.228827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:56:50.228827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: from cryptography.utils import int_from_bytes Aug 10 10:56:50.276771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 10:56:50.276961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 10:56:50.277084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 10:56:50.277163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] command line args: [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 10:56:50.277296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 10:56:50.277380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 10:56:50.277450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] command line args: [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 10:56:50.277572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ================================================================================ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 10:56:50.277795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 10:56:50.277926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] admin_token = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ================================================================================ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 10:56:50.278148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config_dir = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] admin_token = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] config_dir = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config_source = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] debug = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] config_source = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.278954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] debug = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.279952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_config_append = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_config_append = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_dir = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.280907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_dir = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.281929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.282970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.283929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] publish_errors = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.284961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.285121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.285318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.285480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.285602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.285699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.285953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] publish_errors = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] standard_threads = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.286938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] use_journal = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] use_json = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] use_stderr = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] use_syslog = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.287994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.288111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] standard_threads = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.288221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.288462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.288577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.288686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.288803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.288803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.289053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.289053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_journal = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.289288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.289441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_json = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.289559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.289668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_stderr = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.289778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.289892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_syslog = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.290001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:56:50.290256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.290922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.291865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.292739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.293935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.294902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.295896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.296894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.297903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.298853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.299945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.300942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.301982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.302900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.303892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.304997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.305991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.306999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.307894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.308877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.309893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.310911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.external = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.311805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.password = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.token = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.312924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.313903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.external = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.314960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.password = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.token = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.315937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.316924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.317994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.318989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.319961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.320998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.321994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.322973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.323964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.324904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.325984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.326994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.327996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.328896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.329921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.330928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.331986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332555 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.332889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.333940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.334974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.335913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.336906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.337957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.338947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.339958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.340949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.341980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.342976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] role.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] role.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.343970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.344960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.345911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346691 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.346909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.347888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.348919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.349925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.350996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.351984 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.352971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.353994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.354889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.355939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.356932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.357954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.358963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 10:56:50.359735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.359941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.360049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.360277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.360521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.360756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.361015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.361254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.361502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.361737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.361979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.362206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.362443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.362676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:56:50.362843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 10:56:50.388500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.388693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.388886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.391093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.391325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.391547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.398682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.401329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.426960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.427186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.427500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.427734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.478378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.478851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.528319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.528544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.528939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.529245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.591720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.591966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592543 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.592836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.593046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.593227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.593416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.615746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.615959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.616885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.617041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.617124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.617294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.628427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.628556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.641530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.641661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.641741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.641821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.641886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.641946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.642805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 10:56:50.659820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.659950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.660028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 10:56:50.660091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 10:56:50.660357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.660505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.660584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 10:56:50.660648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 10:56:50.660789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.660872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.661105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.661232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.661411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.661538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.661672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.661797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.672903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.673795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.680652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.681075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.683733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.684018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.684139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.684283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.684435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.684515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.684646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.684845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.684967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.685879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.686001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.686130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.686256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.686380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.686504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.686704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.709234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.709856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.710792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.711078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.711384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.711670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.715660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.715943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.716222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.716344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.716499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.716799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.722809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.723096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.723361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.723650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.727876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.727999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.728154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.728325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.728407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.728549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.728706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.728804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.729968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.730091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.745704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.745827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.745972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.746102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.749971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.750167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.753104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.753226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.753371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.753501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.758149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.758272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.761344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.761467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.764469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.764591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.764753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.764881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.765995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.781773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.781895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.782038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.782162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.782283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.782378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.782579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.782669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.789431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.789622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.791004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.791266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.791432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.791533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.794089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.794214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.794372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.794501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.794622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.794831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.794954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.795098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.795264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.795388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.806620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.806825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.806986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.807943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.808066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.808227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.808366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.808528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.824857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.825007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.827836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.828029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.830794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.830918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.832346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.832469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.833846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.833989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.834126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.834204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.834399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.834524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.840865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.841013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.842477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.842601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.845403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.845546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.845682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.845762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.845959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.846083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.846217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.846308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.854219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.854343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.854472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.854553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.854772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.854896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.861638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.861763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 10:56:50.861893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.861973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.862976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.863049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.863222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.863346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.863495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.863576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.863858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.864918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.865171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.865298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 10:56:50.898673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf335059c0 pid: 80428 (default app) Aug 10 10:56:50.898808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf335059c0 pid: 80427 (default app) Aug 10 10:56:50.901929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722c8e-2d56-43b7-bae9-72f7f9a8cfe9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:56:50.902208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722c8e-2d56-43b7-bae9-72f7f9a8cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:56:50.902475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722c8e-2d56-43b7-bae9-72f7f9a8cfe9 None None] PATH_INFO: `/v3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:56:50.906782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Wed Aug 10 10:56:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:56:58.588041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:56:58.588619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:56:58.588619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:56:58.593036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:56:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:56:58.598498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:56:58.598956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:56:58.599046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:56:58.668526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: INFO dbcounter [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] Registered counter for database keystone Aug 10 10:56:58.689599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG oslo_db.sqlalchemy.engines [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:56:58.699585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writer thread running {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:56:58.884494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG passlib.handlers.bcrypt [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80428) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 10:56:58.884839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG passlib.handlers.bcrypt [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80428) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 10:56:58.939903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:56:58.941519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:56:59.076411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:56:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 10:56:59.246619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:56:59.320756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: INFO dbcounter [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] Registered counter for database keystone Aug 10 10:56:59.345253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG oslo_db.sqlalchemy.engines [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:56:59.355674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writer thread running {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:56:59.472912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ff38-fed8-45c6-93d5-b94af2fecaf6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:56:59.478435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:56:59.479047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:56:59.479317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:56:59.479578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:56:59.488557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:56:59.540275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 10:56:59.540605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11b97a-b4b7-49c7-8798-8584ac5504b8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:56:59.550749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 10 10:56:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:56:59.558028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:56:59.582243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a564799-ea30-450a-85dc-97fb8dc400fa None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:56:59.589801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:56:59.590932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:56:59.591210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:56:59.591485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] PATH_INFO: `/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:56:59.593153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] RBAC: Authorizing `identity:get_project(project_id=65fdb45b0c1547cc9b08e89b6225a55f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:56:59.643403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 10:56:59.643990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393e594-58f6-4c96-acac-1e0a205d5253 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:56:59.648348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Aug 10 10:56:59 2022] GET /identity/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:01.627068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5806c-2cfa-40ff-834b-1ded7fcc6928 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:01.627632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5806c-2cfa-40ff-834b-1ded7fcc6928 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:01.627632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5806c-2cfa-40ff-834b-1ded7fcc6928 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:01.632107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:01.638786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:01.639244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:01.639337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:01.671154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:01.672670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:01.682221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 10:57:01.705020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5806c-2cfa-40ff-834b-1ded7fcc6928 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:01.727521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5806c-2cfa-40ff-834b-1ded7fcc6928 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:01.732864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9016b-4749-4def-bb6a-73d501699c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:01.733478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9016b-4749-4def-bb6a-73d501699c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:01.733755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9016b-4749-4def-bb6a-73d501699c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:01.734021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9016b-4749-4def-bb6a-73d501699c5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:01.741968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9016b-4749-4def-bb6a-73d501699c5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:01.743833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9016b-4749-4def-bb6a-73d501699c5f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:01.752711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 10 10:57:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:57:01.761602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:01.775331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb420-475a-4ceb-87a7-a7570e50d097 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:01.780559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0162e5-9d8b-4f7d-80ad-9f025a2b5c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:01.781206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0162e5-9d8b-4f7d-80ad-9f025a2b5c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:01.781481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0162e5-9d8b-4f7d-80ad-9f025a2b5c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:01.781746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0162e5-9d8b-4f7d-80ad-9f025a2b5c19 admin admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:01.783070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0162e5-9d8b-4f7d-80ad-9f025a2b5c19 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:01.784889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0162e5-9d8b-4f7d-80ad-9f025a2b5c19 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:01.786431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Aug 10 10:57:01 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:03.812054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a3e7-708a-45de-bf9a-70bc23867940 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:03.812621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a3e7-708a-45de-bf9a-70bc23867940 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:03.812621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a3e7-708a-45de-bf9a-70bc23867940 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:03.814146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:03.819072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:03.819491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:03.819690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:03.839016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:03.841330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:03.842312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff8486-04dd-43e4-a3eb-1d6ff47c1373 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:03.842740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff8486-04dd-43e4-a3eb-1d6ff47c1373 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:03.843142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff8486-04dd-43e4-a3eb-1d6ff47c1373 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:03.845540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:03.850734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:03.851129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:03.851540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:03.894884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG passlib.handlers.bcrypt [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80427) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 10:57:03.895307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG passlib.handlers.bcrypt [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80427) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 10:57:03.928371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:03.939973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:03.941597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:03.951268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:03.975661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.041539 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:04.056223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1123ae-082b-4d44-b7b6-9b97b02f745f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.063534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.089102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.089739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.090016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.090287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.101218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:04.110030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:04.111106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:04.112040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:04.121462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.171136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0178-fc88-4f96-8f90-2137cc19ddd9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.174405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.209507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.212106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.213009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.213311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.213580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.229979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1124-e6c7-4d27-98d4-ee099074f8ec None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.263883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.264695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.264963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.265261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.265918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:04.266210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.267602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.278888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:04.279419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.281030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.284415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.381953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 10:57:04.388404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.391790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.496565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656a825-a891-4628-895b-6067e1a4598f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.497590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794f87-8893-4fec-9cd2-16764cfe4319 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.531092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.531250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.531711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.531931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.532024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.532206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.532304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.532464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.533367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.534823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.536368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:04.542023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.551179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.552670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.557186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:57:04.571430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:04.572388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:57:04.573264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:57:04.573264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:57:04.573264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:04.573264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:04.578714 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.634321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.645528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e91e9-f752-4bcc-8a71-0ef5fffc602f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.677005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6343cf-27cc-41a3-af2e-7037841e2a11 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.679514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.680195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.680466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.680733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.681889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.683326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.684871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:04.690650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:04.710091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.710703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.710978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.711272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.711916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:04.712211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.713626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef04c3-b1c4-43d1-b907-269e94595ea5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.730776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:04.774067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:04.796228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a675d-3d54-42bf-a746-5985cee47082 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:04.833502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:04.834173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:04.834360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:04.834643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:04.835370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.domain.id=default, user.id=e2ef5869bc0645f193056c60370729ef) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:04.835674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:04.837229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20713cc3-7853-437f-8bb3-942b6b83636c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:04.844706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 10 10:57:04 2022] GET /identity/v3/role_assignments?user.id=e2ef5869bc0645f193056c60370729ef&scope.domain.id=default&role.id=b6a5fb3a069640758072d30fba5d307c => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:07.165527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c339-369f-4067-adaa-3e32e15123b4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.166492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c339-369f-4067-adaa-3e32e15123b4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.166975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c339-369f-4067-adaa-3e32e15123b4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.168550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:07.178408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d06b32-19df-42d4-add9-6ea14b8b224b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.179326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d06b32-19df-42d4-add9-6ea14b8b224b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.179609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d06b32-19df-42d4-add9-6ea14b8b224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.181103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7441-4699-46c9-a9e3-6324be98f985 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.181601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7441-4699-46c9-a9e3-6324be98f985 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.182065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7441-4699-46c9-a9e3-6324be98f985 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.183541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 12/23] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:07.188473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd326430-6473-4edf-bef2-ee06239dccd6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.188961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd326430-6473-4edf-bef2-ee06239dccd6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.189482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd326430-6473-4edf-bef2-ee06239dccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.202174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b0d06b32-19df-42d4-add9-6ea14b8b224b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:07.203652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b0d06b32-19df-42d4-add9-6ea14b8b224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:07.221981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cd326430-6473-4edf-bef2-ee06239dccd6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:07.223192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cd326430-6473-4edf-bef2-ee06239dccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:07.355543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:07.357728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4fae-de3b-47d6-a77d-b25af6daff6f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.358214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4fae-de3b-47d6-a77d-b25af6daff6f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.358399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:07.358841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4fae-de3b-47d6-a77d-b25af6daff6f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.360537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:07.366186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.366477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.366753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.397813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:07.397971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae4fae-de3b-47d6-a77d-b25af6daff6f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:07.399039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:07.493330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:07.519340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:07.520192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:07.529079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:07.637761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae4fae-de3b-47d6-a77d-b25af6daff6f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:07.643307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87c6a-9529-4491-8dfe-0e9d7ec04023 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:07.683179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:07.683712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.683984 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.684250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.684911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:07.686335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:07.710676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:07.711636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:07.718783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:07.719354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:07.749990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:07.756723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:07.757614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:07.758881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 15/28] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:07.759762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:07.837916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 14/29] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 10 10:57:07 2022] POST /identity/v3/roles => generated 219 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:07.838708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:07.987012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.070798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd604ce-71b6-40d5-a62c-23cea8c3feeb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.074612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520eb44-5788-4eb3-a5c7-bf43f61317ca None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.080585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.113278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.113942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.114223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.114495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.115239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:08.115541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.117112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd25855-ff96-4474-948a-fc0816bc1c1f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.124943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.125890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.126168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.126433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.127505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:08.129865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299114-33f6-4d65-ade8-d6ddf1d543a0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.130142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299114-33f6-4d65-ade8-d6ddf1d543a0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.130409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299114-33f6-4d65-ade8-d6ddf1d543a0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.134151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 16/31] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:08.134151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da51014-b076-4ea0-9fe0-1ef47514402b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.138682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da51014-b076-4ea0-9fe0-1ef47514402b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.138682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da51014-b076-4ea0-9fe0-1ef47514402b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.139978 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 17/32] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:08.140708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da51014-b076-4ea0-9fe0-1ef47514402b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.145123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.147050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-8cf39df9-0e85-4f7c-bee1-dc6cd35aeb64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:57:08.164483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:08.165412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:57:08.166647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:57:08.166647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:57:08.166647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:08.166647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 16/33] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:08.167312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa486-f098-4ec0-ae16-ec86c01b54a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.167312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa486-f098-4ec0-ae16-ec86c01b54a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.167528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa486-f098-4ec0-ae16-ec86c01b54a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.194136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e67fa486-f098-4ec0-ae16-ec86c01b54a3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:08.195321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e67fa486-f098-4ec0-ae16-ec86c01b54a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:08.259997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da51014-b076-4ea0-9fe0-1ef47514402b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.265800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 17/34] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:08.266868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.267143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.267412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.289034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:08.290334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:08.296887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.309756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.310636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.311581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.311993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.314115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.316533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.321176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:08 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:08.322068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.364081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 18/36] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:08.365296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.392081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.431245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618bee8-5809-481d-9500-f38c86677c8f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.466340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.466930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.467207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.467472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.468122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:08.468422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.469853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.479812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199d1b-590b-4055-833a-06b30af82f4f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.490725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 19/37] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:08.490725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.521111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.521797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.522009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.522274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.522935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.524391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.548757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.597373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdd10f-e1a3-46be-b549-56860a0816e6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.631432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.632076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.632356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.632627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.633894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.635390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.636944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:08.637710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.653491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 10 10:57:08 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:08.654531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.755770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06998f10-b3f9-49f4-9877-59a8662249b3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.756824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.783080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d8507-6792-410c-b619-4caf18e0b141 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.786978 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:08.802178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3d35-d97d-43dd-9542-1522fa01ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.802822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3d35-d97d-43dd-9542-1522fa01ce3c None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.803101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3d35-d97d-43dd-9542-1522fa01ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.803370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3d35-d97d-43dd-9542-1522fa01ce3c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.804046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3d35-d97d-43dd-9542-1522fa01ce3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.805638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3d35-d97d-43dd-9542-1522fa01ce3c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.823339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 10 10:57:08 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:08.824213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc019e75-ecbd-48fd-8102-1df4f3454668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:08.824844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019e75-ecbd-48fd-8102-1df4f3454668 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.825211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019e75-ecbd-48fd-8102-1df4f3454668 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.825478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019e75-ecbd-48fd-8102-1df4f3454668 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.825670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2915c7-29e8-4cd7-a341-f4ecbd6bbc37 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.826108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2915c7-29e8-4cd7-a341-f4ecbd6bbc37 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.826394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc019e75-ecbd-48fd-8102-1df4f3454668 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:08.826742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2915c7-29e8-4cd7-a341-f4ecbd6bbc37 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.828006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc019e75-ecbd-48fd-8102-1df4f3454668 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:08.828416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 22/41] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:08.829344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2915c7-29e8-4cd7-a341-f4ecbd6bbc37 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:08.865206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 20/42] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:57:08 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:08.867024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:08.867577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:08.868082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:08.892400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:08.894083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:08.982098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2915c7-29e8-4cd7-a341-f4ecbd6bbc37 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:08.982341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 21/43] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:09.005678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:09.031897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:09.032586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:09.032860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:09.033209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] PATH_INFO: `/v3/domains/default/users/e2ef5869bc0645f193056c60370729ef/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:09.038143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e2ef5869bc0645f193056c60370729ef, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:09.040649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:09.060031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1361 bytes} [Wed Aug 10 10:57:08 2022] PUT /identity/v3/domains/default/users/e2ef5869bc0645f193056c60370729ef/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:09.092506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:09.142332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb8da-3e10-43c7-952c-4db45f2865b6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:09.181893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96cfd-92cd-446d-b3f8-01ea5cc28cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:09.182552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96cfd-92cd-446d-b3f8-01ea5cc28cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:09.182810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96cfd-92cd-446d-b3f8-01ea5cc28cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:09.183077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96cfd-92cd-446d-b3f8-01ea5cc28cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:09.184210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b96cfd-92cd-446d-b3f8-01ea5cc28cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:09.185725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b96cfd-92cd-446d-b3f8-01ea5cc28cc3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:09.187352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:09.193463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:09.247683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:09.310504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01227dc-f21b-4a2d-8a5a-b3c49fa21545 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:09.345915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc88a-c375-4cdf-b191-2f06b73e651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:09.346529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc88a-c375-4cdf-b191-2f06b73e651c None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:09.346804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc88a-c375-4cdf-b191-2f06b73e651c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:09.347072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc88a-c375-4cdf-b191-2f06b73e651c None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:09.347718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc88a-c375-4cdf-b191-2f06b73e651c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:09.349216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc88a-c375-4cdf-b191-2f06b73e651c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:09.378031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:57:09 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:11.047856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310e37-c280-45e6-bd98-cec2b98113c9 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.048438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310e37-c280-45e6-bd98-cec2b98113c9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.048438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310e37-c280-45e6-bd98-cec2b98113c9 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.049744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:11.055329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.055770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.055923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.074486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:11.075988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:11.147070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:11.169491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310e37-c280-45e6-bd98-cec2b98113c9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.274821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310e37-c280-45e6-bd98-cec2b98113c9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.301903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:11.316172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60751be-9837-49a5-84bd-1cd7fe915103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.316813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60751be-9837-49a5-84bd-1cd7fe915103 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.317135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60751be-9837-49a5-84bd-1cd7fe915103 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.317406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60751be-9837-49a5-84bd-1cd7fe915103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.327999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60751be-9837-49a5-84bd-1cd7fe915103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c60751be-9837-49a5-84bd-1cd7fe915103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:11.332804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:11.333666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:11.335100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:11.340315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.355914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc631-0e1e-45e1-8ac2-cad710448b7b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.356190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc631-0e1e-45e1-8ac2-cad710448b7b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.356464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc631-0e1e-45e1-8ac2-cad710448b7b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.357832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 25/50] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:11.362776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.363055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.363323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.383085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:11.386711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:11.387944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:11.457080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:11.461053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966bcc7-f0fc-4ce3-906b-2b6f07a94f27 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.479087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.493294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.493905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.494179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.494438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.495097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:11.495399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:11.496786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:11.504700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:11.510645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.577557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1754a-94e0-4ea3-812e-8f7a4b33cb81 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.590970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:11.594368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:11.606408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f634948-fb6a-4756-b9ca-88201383435f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.611914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.612547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.612824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.613125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.614226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:11.615666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:11.617466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:11.622974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.639115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.639742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.640058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.640314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.641456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:11.642898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:11.644467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:11 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:11.649971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.729290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5cca9-6f48-4b79-a411-5af252ab91c4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.751010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701901e9-187d-4adb-bc43-03bf5d918054 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.763988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b852f-2244-4581-a175-4cce6577d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.764597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b852f-2244-4581-a175-4cce6577d5f6 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.764878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b852f-2244-4581-a175-4cce6577d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.765175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b852f-2244-4581-a175-4cce6577d5f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.765828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b852f-2244-4581-a175-4cce6577d5f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:11.767278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b852f-2244-4581-a175-4cce6577d5f6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:11.784160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.784863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.785187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.785510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.786653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:11.788168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:11.790094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:11.793887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 28/56] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 10 10:57:11 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:57:11.795545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:11.824726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:11.905968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f79a1-513e-404c-919d-601dc7ac2e48 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:11.942726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:11.943347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:11.943621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:11.943888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:11.944681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.domain.id=default, user.id=e2ef5869bc0645f193056c60370729ef) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:11.945010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:11.946585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef01d-fc17-41ed-aa01-e4159c81ba31 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:11.953462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 10 10:57:11 2022] GET /identity/v3/role_assignments?user.id=e2ef5869bc0645f193056c60370729ef&scope.domain.id=default&role.id=b6a5fb3a069640758072d30fba5d307c => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:13.768356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6527-518b-4d2b-b607-1e61fb64b67c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:13.769238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6527-518b-4d2b-b607-1e61fb64b67c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:13.769238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6527-518b-4d2b-b607-1e61fb64b67c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:13.771907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:13.778125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:13.778789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:13.778914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:13.806995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:13.808167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:13.882737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:13.906864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6527-518b-4d2b-b607-1e61fb64b67c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:13.956795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:14.020286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6527-518b-4d2b-b607-1e61fb64b67c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:14.054835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b888b-6370-4e87-b08b-564da94d453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:14.055445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b888b-6370-4e87-b08b-564da94d453a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:14.055716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b888b-6370-4e87-b08b-564da94d453a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:14.055983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b888b-6370-4e87-b08b-564da94d453a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:14.057243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b888b-6370-4e87-b08b-564da94d453a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:14.058693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b888b-6370-4e87-b08b-564da94d453a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:14.060217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:14.066650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:14.091058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:14.180120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36a72-c5ca-406a-8120-dbf0ae8138ee None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:14.219953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6b3f9-412e-480f-92ee-b19eec78b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:14.220545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6b3f9-412e-480f-92ee-b19eec78b41e None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:14.220819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6b3f9-412e-480f-92ee-b19eec78b41e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:14.221118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6b3f9-412e-480f-92ee-b19eec78b41e None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:14.221748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6b3f9-412e-480f-92ee-b19eec78b41e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:14.223196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6b3f9-412e-480f-92ee-b19eec78b41e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:14.254909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:14 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:17.589927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01631c-ed03-4686-8aaf-60126a9c22ca None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:17.590951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01631c-ed03-4686-8aaf-60126a9c22ca None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:17.591448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01631c-ed03-4686-8aaf-60126a9c22ca None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:17.593016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:17.598373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:17.599151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:17.599609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:17.630016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:17.631940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:17.671570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c436-a5e3-4026-a378-fa766d896e71 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:17.672177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c436-a5e3-4026-a378-fa766d896e71 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:17.672639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c436-a5e3-4026-a378-fa766d896e71 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:17.674237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:17.687497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:17.688175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:17.688640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:17.721151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:17.722786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:17.727951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 32/64] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:17.750715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:17.753345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:17.862863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ad12-aa9a-41a8-8a73-c167c63f7087 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:17.898940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:17.899964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:17.900431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:17.900884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:17.912278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:17.917714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:17.918825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:17.919833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:17.920506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 33/65] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:17.926772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 33/66] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:17.928249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:17.941953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:17.995038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.007030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.048594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6858e-92fd-4e3a-ab72-2edd50720f50 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.075128 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df60b8-82a7-4948-99f2-5c1fe1b7398e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.083565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819fe69-b66a-4e2c-a49f-e22a9b7c3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.084500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819fe69-b66a-4e2c-a49f-e22a9b7c3d1a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.084844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819fe69-b66a-4e2c-a49f-e22a9b7c3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.085146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819fe69-b66a-4e2c-a49f-e22a9b7c3d1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.095236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819fe69-b66a-4e2c-a49f-e22a9b7c3d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6819fe69-b66a-4e2c-a49f-e22a9b7c3d1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:18.099980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:18.100837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:18.101917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 34/67] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:18.102780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cccd8-2503-4faf-9cee-16a685ac2e00 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.103032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cccd8-2503-4faf-9cee-16a685ac2e00 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.103315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cccd8-2503-4faf-9cee-16a685ac2e00 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.104530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 35/68] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:18.106039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b1f71-2722-490b-bd8f-766c345aec2d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.106039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b1f71-2722-490b-bd8f-766c345aec2d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.106262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b1f71-2722-490b-bd8f-766c345aec2d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.108241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 36/69] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:18.110179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b1f71-2722-490b-bd8f-766c345aec2d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.119135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.119708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.119969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.120239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.120906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:18.121235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.122634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791ccf5-dc66-4f61-8eba-78e379ab4def None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.136368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 34/70] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:18.138838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665f75d-1cb8-42c9-bf3d-067e9c89ecfd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.139379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665f75d-1cb8-42c9-bf3d-067e9c89ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.140087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665f75d-1cb8-42c9-bf3d-067e9c89ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.158226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5665f75d-1cb8-42c9-bf3d-067e9c89ecfd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:18.159416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5665f75d-1cb8-42c9-bf3d-067e9c89ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:18.221237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b1f71-2722-490b-bd8f-766c345aec2d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.240997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 35/71] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:18.240997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8ccd-75f3-4886-8fdc-4f78515294a4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.240997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8ccd-75f3-4886-8fdc-4f78515294a4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.240997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8ccd-75f3-4886-8fdc-4f78515294a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.246590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.251044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8cfa8ccd-75f3-4886-8fdc-4f78515294a4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:18.252216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8cfa8ccd-75f3-4886-8fdc-4f78515294a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:18.259993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.260603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.260875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.261173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.261841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:18.262449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.263768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.271517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:18.272288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.276646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.319953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 36/73] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:18.321218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d939-34d1-4d9e-84f2-f338703c8c3f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.321492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d939-34d1-4d9e-84f2-f338703c8c3f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.321763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d939-34d1-4d9e-84f2-f338703c8c3f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.323133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 37/74] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:18.323746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640d939-34d1-4d9e-84f2-f338703c8c3f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.375882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f5aa-a84b-409d-a064-3809c35647f1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.409513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.410165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.410447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.410711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.423994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.424776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640d939-34d1-4d9e-84f2-f338703c8c3f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.425506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.427149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:18.427901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.462902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b4e65-e891-41d4-910f-d5e61a584c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.463544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b4e65-e891-41d4-910f-d5e61a584c77 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.463816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b4e65-e891-41d4-910f-d5e61a584c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.464077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b4e65-e891-41d4-910f-d5e61a584c77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.465174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b4e65-e891-41d4-910f-d5e61a584c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.466602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b4e65-e891-41d4-910f-d5e61a584c77 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.468192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 38/76] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:18.469309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.470207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.470464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.470785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.487924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:18.489150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:18.509076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.534895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aae9b-a3dd-44a9-bfeb-8dbdb7ead34c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.563711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 39/77] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:18.564579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.575813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.576607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.576954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.577328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.578587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.580186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.582018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 39/78] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:18.582677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.666942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfbac9-52a8-490d-817c-147065b42280 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.678954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31719b-2a8c-4d13-b4c9-7106e290d3ea None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.689122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.700112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.700748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.701055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.701350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.711589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:18.713159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.713764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.714039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.714306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:18.716288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:18.717148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:18.717908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 40/79] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:18.723276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.741062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.784940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.786441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.821714 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ca712-c167-483f-b1b6-8c000ef48d7e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:18.855195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:18.855805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:18.856081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:18.856347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:18.857037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:18.858533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:18.884190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 40/80] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:18.885238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.886369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 41/81] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:18 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:18.887220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:18.901037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:18.969373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.003176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cabf0f-256d-4500-a319-4e0db840cff4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.005019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae747b32-c8dd-4761-8eb5-dd2db055f4cb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.044197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.044431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.044533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.044611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.044677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.044677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.044807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.044807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.057154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:19.061931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:19.062804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:19.063561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 41/82] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:19.064190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.130302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.132794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.140160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.182941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cc758-74cd-43c7-b668-2ee2b6d475f1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.223752 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.223919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.224905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.225354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.225574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.226254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:19.226602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.228102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.237856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 42/83] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.238491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.261318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 42/84] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:19.262197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.352845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58edf-2b94-4e9a-84ca-296a34696c97 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.384866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.390240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.391044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.391471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.391784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.392456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fdd39-ee1b-48e3-848b-6c2d70599ef0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.393057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.394701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.396337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 43/85] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.397167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.430674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.431283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.431556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.431841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.432475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:19.432770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.434291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.443012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 43/86] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.443746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.480591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.518833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048609-983a-4cc1-8ec9-469d42b7cffb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.551189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc442cd9-9fdd-49ea-9a6c-372768690c72 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.553042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.553697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.553972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.554239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.555416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.556875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.563168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 44/87] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.563999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.585546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.586221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.586588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.586862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.587995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.589758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.591501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 44/88] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.597113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.631479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.665485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e8fad-5a24-475f-b24f-9ac449d48c2a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.698877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.699529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.699746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.700019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.700808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=18066180735a47d6af84e13c7ce55ee2) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:19.701160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.701663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e1f7-9164-494a-8b0c-7e338f3bd49d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.702637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.709436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 45/89] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/role_assignments?user.id=18066180735a47d6af84e13c7ce55ee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.710068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.710445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.748635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.749467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.749751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.750026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.752544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.754172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.756523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 45/90] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.758201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.827519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e551ac4-4378-4c11-a3ce-c76dcc7a8154 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.867115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:19.872694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.873443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.873726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.874312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.900425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ade98-c4b9-4419-8f01-788fee1706df None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:19.936141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:19.936876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:19.937271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:19.937547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:19.938331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=e2ef5869bc0645f193056c60370729ef) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:19.938639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.940092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:19.949749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 46/91] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/role_assignments?user.id=e2ef5869bc0645f193056c60370729ef&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:19.950627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:19.990025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:19.992930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:20.036705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:20.220861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285106f8-9e7c-41b1-b5fe-2ccd423b8d6b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:20.267412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 46/92] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:20.274461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:20.305090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:20.305090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:20.305090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:20.305090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:20.337008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:20.448366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:20.449884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:20.477560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332a89-ab1e-471d-a416-967dc3ff1c29 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:20.517349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:20.546529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:20.547172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:20.547449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:20.547718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:20.551644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:20.553154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:20.562014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 47/93] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:20 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:20.566910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:20.654992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:20.660493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:20.756500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:20.763998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac45f-3089-44d5-99c6-a2f207ae0c97 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:20.838013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:20.838565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:20.838839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:20.839106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:20.839843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] RBAC: Adding query filter params (role.id=137d83a6d55341aab18d66327415150f, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=18066180735a47d6af84e13c7ce55ee2) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:20.840148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:20.841642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:20.853763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 48/95] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:20 2022] GET /identity/v3/role_assignments?user.id=18066180735a47d6af84e13c7ce55ee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=137d83a6d55341aab18d66327415150f => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:20.873682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e91a6-8f8e-4b0d-a985-7bd8b79e363f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:20.919288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fabdb-5ce4-44cc-af6a-c3d033553726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:20.919947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fabdb-5ce4-44cc-af6a-c3d033553726 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:20.920223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fabdb-5ce4-44cc-af6a-c3d033553726 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:20.920492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fabdb-5ce4-44cc-af6a-c3d033553726 None admin] PATH_INFO: `/v3/projects/a09a19716e25463b915cad90f4cc670d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:20.921652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fabdb-5ce4-44cc-af6a-c3d033553726 None admin] RBAC: Authorizing `identity:get_project(project_id=a09a19716e25463b915cad90f4cc670d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:20.923181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fabdb-5ce4-44cc-af6a-c3d033553726 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:20.925039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:20 2022] GET /identity/v3/projects/a09a19716e25463b915cad90f4cc670d => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:20.931127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:21.042268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c31f-f5ad-4012-8d79-e09fec80eb1a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:21.089055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:21.089615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:21.089947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:21.090228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:21.090976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=a09a19716e25463b915cad90f4cc670d, user.id=18066180735a47d6af84e13c7ce55ee2) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:21.091285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:21.092798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9ded-03b2-4428-adcf-5bda39a240a1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:21.105844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 49/97] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:20 2022] GET /identity/v3/role_assignments?user.id=18066180735a47d6af84e13c7ce55ee2&scope.project.id=a09a19716e25463b915cad90f4cc670d&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:21.649504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222495b-daab-42d2-8e2b-50e1c6f11618 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:21.649911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222495b-daab-42d2-8e2b-50e1c6f11618 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:21.650102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222495b-daab-42d2-8e2b-50e1c6f11618 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:21.651416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 49/98] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:21.656787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:21.657106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:21.657384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:21.662620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256664-0f6b-4815-9bad-0d50937d3c59 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:21.662911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256664-0f6b-4815-9bad-0d50937d3c59 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:21.663182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256664-0f6b-4815-9bad-0d50937d3c59 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:21.664694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 50/99] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:21.689587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:21.690782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:21.693604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:21.693883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:21.694150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:21.700528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:21.724008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:21.725241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:21.744571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:21.823967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 50/100] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:21.845009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 51/101] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:21.846779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:21.901382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:22.000747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82058d-1780-4508-b2d6-47cea06e6456 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:22.062524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7dc4e-d338-4ee2-800e-e85ef902a871 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:22.093722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:22.094660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:22.095077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:22.095479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:22.096348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:22.097124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:22.098405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:22.100402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 51/102] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:22.103021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:22.103944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:22.104401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:22.104848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:22.107731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:22.120072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:22.125731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:22.126668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:22.127418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:22.130369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 52/103] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:22.137545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:22.170853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:22.289561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444022c-82bc-4bb2-8c72-180cbfa99bea None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:22.315064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10ee1e-c29b-4d53-a0ce-36c352493d45 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:22.323747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:22.324372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:22.324673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:22.324913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:22.325611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:22.325907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:22.327314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:22.335907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 53/104] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:22.341390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:22.385123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:22.385840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:22.386117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:22.386381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:22.387041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:22.388613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:22.397674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:22.445792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbb6da-79fa-4310-be07-a5b659d3a2db None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:22.455370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 52/105] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:57:22 2022] POST /identity/v3/projects => generated 302 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:22.483845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:22.484508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:22.484789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:22.485143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] PATH_INFO: `/v3/users/cc8535a8a69d4f6da42d8ce62b411989` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:22.503351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] RBAC: Authorizing `identity:get_user(user_id=cc8535a8a69d4f6da42d8ce62b411989)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:22.504873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:22.507046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 54/106] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:22 2022] GET /identity/v3/users/cc8535a8a69d4f6da42d8ce62b411989 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:22.512832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:22.607719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:22.634146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea25e-c5d1-44f3-9512-08c9a7a2feb3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:22.677397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec6eae-d0cf-4cfe-859f-36c0f8c7a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:22.678021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec6eae-d0cf-4cfe-859f-36c0f8c7a841 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:22.678301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec6eae-d0cf-4cfe-859f-36c0f8c7a841 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:22.678570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec6eae-d0cf-4cfe-859f-36c0f8c7a841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:22.773864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec6eae-d0cf-4cfe-859f-36c0f8c7a841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:22.775394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec6eae-d0cf-4cfe-859f-36c0f8c7a841 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:22.863901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:22.889811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:22.895669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.001722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18c3d-e523-484f-97e8-01341ff3ddfa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:23.022641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:23.035634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06131fe3-a8cd-4da2-8a6b-f1851fe670d8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.035905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06131fe3-a8cd-4da2-8a6b-f1851fe670d8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.036110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06131fe3-a8cd-4da2-8a6b-f1851fe670d8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.037515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 54/108] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:23.046315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382754-d13e-4b7d-9dee-0575518e1c68 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.046599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382754-d13e-4b7d-9dee-0575518e1c68 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.046877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382754-d13e-4b7d-9dee-0575518e1c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.048124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:23.048791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.049137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.049410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.050655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:23.052118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:23.054084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 55/109] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:22 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:23.074097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.074264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4d382754-d13e-4b7d-9dee-0575518e1c68 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:23.075466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4d382754-d13e-4b7d-9dee-0575518e1c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:23.168860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 55/110] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:23.170382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95731ca3-708a-415a-b2d9-fdd8d3f7956b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.170665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95731ca3-708a-415a-b2d9-fdd8d3f7956b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.170991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95731ca3-708a-415a-b2d9-fdd8d3f7956b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.172461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 56/111] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:23.182498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.182767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.183139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.214053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:23.215254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:23.284835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4449-05d1-4466-a2ea-2e9deec8b9ea None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:23.331227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:23.331760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.332044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.332310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.333050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] RBAC: Adding query filter params (role.id=4cedf324d1e44684bad58ada65aff942, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=cc8535a8a69d4f6da42d8ce62b411989) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:23.333352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:23.334790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:23.341675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 56/112] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:23 2022] GET /identity/v3/role_assignments?user.id=cc8535a8a69d4f6da42d8ce62b411989&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=4cedf324d1e44684bad58ada65aff942 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:23.342377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.358486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 57/113] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:23.393136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:23.395080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.482682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:23.515423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bca882-9f27-47d7-84da-d7a5108a85db None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:23.608552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f815cf3-12d5-4fce-88d7-39dbdc96b440 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:23.617767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:23.618432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.618710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.618976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.641107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:23.648747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:23.649814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:23.650646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:23.654564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 57/114] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:23.660282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:23.661454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.662705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.663514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.665182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.688216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:23.694680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:23.695770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:23.696725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:23.698771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 58/115] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:23.705048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.850103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c87c3-02be-4988-8bd8-103d28cec864 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:23.860946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:23.886580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:23.893665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754f02-8097-4493-b8c7-b755af6d5d8b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:23.917388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:23.918413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.919681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.920883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.921900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:23.923437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:23.925037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799ba8-db75-4865-bf4c-962311088a0c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:23.939895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 58/116] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:23.941600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685569-aa74-40ec-8597-d8c6f9a8492d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.942067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685569-aa74-40ec-8597-d8c6f9a8492d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.942542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685569-aa74-40ec-8597-d8c6f9a8492d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.943970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 59/117] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:23.945428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d339-5b07-4d72-a507-5b0d45c2a4c2 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.945865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d339-5b07-4d72-a507-5b0d45c2a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.946300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d339-5b07-4d72-a507-5b0d45c2a4c2 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.947827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 60/118] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:23.948745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d339-5b07-4d72-a507-5b0d45c2a4c2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:23.955886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:23.956568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.956847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.957147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.957830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:23.958128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:23.959608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb21be-eb3f-448b-89fd-63d537f8ba62 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:23.968783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 59/119] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:23.970177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c72d0-6b63-4e92-a735-66f7d86e05be None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:23.970470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c72d0-6b63-4e92-a735-66f7d86e05be None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:23.970740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c72d0-6b63-4e92-a735-66f7d86e05be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:23.988781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-190c72d0-6b63-4e92-a735-66f7d86e05be None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:23.990222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-190c72d0-6b63-4e92-a735-66f7d86e05be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:24.064136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d339-5b07-4d72-a507-5b0d45c2a4c2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.073989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 60/120] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:24.075482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.075981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.076484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.096209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:24.097750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:24.122456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.122756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.122995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.123259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.124387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.127882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.127882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 61/121] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:23 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:24.128540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.181469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.196639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 61/122] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:24.197714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.223049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.234377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8e3b-f315-424a-b6f1-5e2b9abb9e10 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.271791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.272570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.272916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.273427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.274729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.276390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.278474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 62/123] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:24.279523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.313435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca4bb2-4326-4947-821a-d4ad82990f6a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.350640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.351763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.352210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.352745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.363781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:24.369246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:24.370104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:24.370859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:24.373284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 62/124] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:24.374401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.383973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ff0f-8139-4124-bbab-8cbe1c4aff2e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.385650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.422317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.422975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.423255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.423519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.424897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.426498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.428170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 63/125] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:24.433917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.472768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.495735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856abc3-85bf-476c-9b1c-fd4d6e184a98 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.533114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.534082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.534559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.534732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141c8dc-e417-41d1-ba02-a86adbf1779a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.535199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.548423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:24.553804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:24.554782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:24.555558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:24.558033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 63/126] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:24.559146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.569967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.570703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.573656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.573656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.580479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.582824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.585873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 64/127] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:24.587421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.639701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.690333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ededa5-3f88-4b7d-88a3-72a7eed6409f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.708546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce878e-7f48-4119-ab7a-45371b679b30 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.728899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.729930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.730420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.730890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.731899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:24.732507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.734201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.743539 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.744197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.744467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.744732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/18066180735a47d6af84e13c7ce55ee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.745070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 64/128] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:24.746333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.746834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] RBAC: Authorizing `identity:create_grant(project_id=4d5aed4d3bc249fc911d4a7ded8a1799, user_id=18066180735a47d6af84e13c7ce55ee2, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.748277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.749867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.769231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 65/129] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:24 2022] PUT /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/18066180735a47d6af84e13c7ce55ee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:24.769881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.874218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28130c17-b042-4f5b-8421-6b0acbe5174d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:24.912595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:24.916345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:24.917020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:24.917522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:24.918522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:24.919124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:24.920728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:24.930159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 65/130] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:24.931554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:24.988818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:24.993122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478ca7-34f3-4dac-9dab-a40322fa13ac None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.006631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:25.033903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.034565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.034845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.035116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/e2ef5869bc0645f193056c60370729ef/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.037082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d5aed4d3bc249fc911d4a7ded8a1799, user_id=e2ef5869bc0645f193056c60370729ef, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.038561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.054336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae27c3-2993-4788-95e8-256253267a98 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.056625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 66/131] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:24 2022] PUT /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/e2ef5869bc0645f193056c60370729ef/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:25.058510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:25.103696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.105503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.105968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.106415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.107920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.109703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.112129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 66/132] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:24 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:25.120533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:25.243913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d8c03-3544-4686-8bdc-190e8008ddaf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.268700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf0b9-451a-4862-b49b-24b7f2f643b3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.278454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:25.284813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.286125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.286546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.286955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] PATH_INFO: `/v3/projects/a09a19716e25463b915cad90f4cc670d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.288497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] RBAC: Authorizing `identity:get_project(project_id=a09a19716e25463b915cad90f4cc670d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.291143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.292991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 67/133] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:25 2022] GET /identity/v3/projects/a09a19716e25463b915cad90f4cc670d => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:25.302839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:25.373035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.373035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.373035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.373035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.373487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.374748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.376716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 67/134] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:25 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:25.385949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:25.443793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:25.507579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b376-9413-4a15-8bc0-b2798826d766 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.537291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c515f-dfd8-4b83-afe5-4a5f3379e5e6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.582975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.583949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.584330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.585011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.586307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.588038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.590444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 68/135] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:25 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:25.596559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:25.603040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c391f6-b46c-4a7a-8838-402ca2585ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.603726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c391f6-b46c-4a7a-8838-402ca2585ca0 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.604005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c391f6-b46c-4a7a-8838-402ca2585ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.604276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c391f6-b46c-4a7a-8838-402ca2585ca0 None admin] PATH_INFO: `/v3/projects/a09a19716e25463b915cad90f4cc670d/users/18066180735a47d6af84e13c7ce55ee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.610252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c391f6-b46c-4a7a-8838-402ca2585ca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09a19716e25463b915cad90f4cc670d, user_id=18066180735a47d6af84e13c7ce55ee2, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.611734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c391f6-b46c-4a7a-8838-402ca2585ca0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.643390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 68/136] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:25 2022] PUT /identity/v3/projects/a09a19716e25463b915cad90f4cc670d/users/18066180735a47d6af84e13c7ce55ee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:25.658081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee1b68-cba5-4905-8285-69084370c874 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.658478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee1b68-cba5-4905-8285-69084370c874 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.658653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee1b68-cba5-4905-8285-69084370c874 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.660128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 69/137] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:25.666072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.666360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.666615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.705573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:25.706756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:25.715843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:25.724289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7ff7e-0d35-4eaa-9cc4-8f7d0ad3419d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:25.766042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:25.767132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:25.767662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:25.768138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/18066180735a47d6af84e13c7ce55ee2/roles/137d83a6d55341aab18d66327415150f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:25.770795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] RBAC: Authorizing `identity:create_grant(project_id=4d5aed4d3bc249fc911d4a7ded8a1799, user_id=18066180735a47d6af84e13c7ce55ee2, role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:25.772525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:25.793006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 69/138] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:25 2022] PUT /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/18066180735a47d6af84e13c7ce55ee2/roles/137d83a6d55341aab18d66327415150f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:57:25.825158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:25.839045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 70/139] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:25.879335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:26.005564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c0dfb-1f60-409c-a55a-5f6fe5c7d62c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:26.043582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4734f7-2c41-4f2e-8f51-5cb23ae6c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:26.044758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4734f7-2c41-4f2e-8f51-5cb23ae6c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.045293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4734f7-2c41-4f2e-8f51-5cb23ae6c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.045786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4734f7-2c41-4f2e-8f51-5cb23ae6c2f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.047237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4734f7-2c41-4f2e-8f51-5cb23ae6c2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:26.048924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4734f7-2c41-4f2e-8f51-5cb23ae6c2f2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:26.050820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 70/140] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:26.056685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:26.074870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3acf3c-cbe2-4a28-b91d-fd837019d9c9 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.075532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3acf3c-cbe2-4a28-b91d-fd837019d9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.076027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3acf3c-cbe2-4a28-b91d-fd837019d9c9 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.077766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 71/141] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:26.084095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.084675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.085172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.114436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:26.121005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:26.159292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:26.192098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492ff0d-405e-4e50-910f-ef9a76875157 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:26.237366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:26.238373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.238847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.239307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.240164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:26.241847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:26.264064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 72/142] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:26.280771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 71/143] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:26 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:26.320439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:26.465686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aae07-6603-4488-a9c0-eb21f814cdb3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:26.506377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:26.507460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.507969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.508433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.519739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:26.525151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:26.526033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:26.526824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:26.530580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 73/144] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:26.537155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:26.590835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:26.656483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628820d5-b15a-4cf6-9b6a-e8a989bcd213 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:26.695025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:26.696049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.696518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.697013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.697905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:26.698495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:26.700671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:26.710429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 72/145] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:26.723916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:26.741587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:26.836670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386721-db40-4235-b731-b7efc7c045e8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:26.877434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:26.878421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:26.878902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:26.879366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] PATH_INFO: `/v3/users/cc8535a8a69d4f6da42d8ce62b411989` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:26.880731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] RBAC: Authorizing `identity:get_user(user_id=cc8535a8a69d4f6da42d8ce62b411989)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:26.882839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:26.884677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 74/146] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:26 2022] GET /identity/v3/users/cc8535a8a69d4f6da42d8ce62b411989 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:26.890659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:27.000131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5804ab-d357-4e4e-b5ab-bb84ecf9399d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:27.010699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:27.039288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a4431-0e2f-4f28-85df-61d00a1b1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:27.040289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4431-0e2f-4f28-85df-61d00a1b1941 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:27.040754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4431-0e2f-4f28-85df-61d00a1b1941 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:27.041246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4431-0e2f-4f28-85df-61d00a1b1941 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:27.042549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4431-0e2f-4f28-85df-61d00a1b1941 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:27.044236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4431-0e2f-4f28-85df-61d00a1b1941 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:27.046173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 73/147] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:26 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:27.052248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:27.161236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:27.185770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623769-afb2-4b01-be83-1fd1d65a19cb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:27.225828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff570-ff8d-4e14-b31f-ccabdad485b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:27.227043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff570-ff8d-4e14-b31f-ccabdad485b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:27.227550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff570-ff8d-4e14-b31f-ccabdad485b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:27.228012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff570-ff8d-4e14-b31f-ccabdad485b8 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/cc8535a8a69d4f6da42d8ce62b411989/roles/4cedf324d1e44684bad58ada65aff942` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:27.231674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ff570-ff8d-4e14-b31f-ccabdad485b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d5aed4d3bc249fc911d4a7ded8a1799, user_id=cc8535a8a69d4f6da42d8ce62b411989, role_id=4cedf324d1e44684bad58ada65aff942)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:27.233464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ff570-ff8d-4e14-b31f-ccabdad485b8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:27.261173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 75/148] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:27 2022] PUT /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/users/cc8535a8a69d4f6da42d8ce62b411989/roles/4cedf324d1e44684bad58ada65aff942 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:27.397175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6434e-a947-459a-8d03-decc0964fe62 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:27.398113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6434e-a947-459a-8d03-decc0964fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:27.398669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6434e-a947-459a-8d03-decc0964fe62 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:27.400295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 74/149] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:27.406472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:27.407401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:27.407861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:27.432107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:27.433655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:27.511570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 76/150] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:27.541704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6434e-a947-459a-8d03-decc0964fe62 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:27.659984 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6434e-a947-459a-8d03-decc0964fe62 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:27.697845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:27.698821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:27.699303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:27.699759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:27.711182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:27.718734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:27.719604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:27.720363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:27.723840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 75/151] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:27.731417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:27.833602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:27.869277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811ddc8-74db-4086-994d-0f920a0e8d4a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:27.916915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:27.917466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:27.917739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:27.917999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:27.918673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:27.918967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:27.920345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:27.933101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 77/152] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:27.937437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:28.001287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:28.086748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292552b-527a-4509-8a80-fff7d62ba468 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:28.142426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1c799-55fa-440d-bd1e-7ccf4738135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:28.143470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1c799-55fa-440d-bd1e-7ccf4738135c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.143936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1c799-55fa-440d-bd1e-7ccf4738135c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.144391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1c799-55fa-440d-bd1e-7ccf4738135c None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.145781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1c799-55fa-440d-bd1e-7ccf4738135c None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:28.147444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1c799-55fa-440d-bd1e-7ccf4738135c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:28.149363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 76/153] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:27 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:28.155194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:28.176573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ddbe2-5689-4765-9139-99785a2cbdf9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.177214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ddbe2-5689-4765-9139-99785a2cbdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.177685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ddbe2-5689-4765-9139-99785a2cbdf9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.179492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 77/154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:28.186233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.186780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.187240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.209270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:28.211009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:28.279440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7363-32b5-4648-b0d5-4e2cbaeaedd7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:28.290875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 78/155] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:28.310494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:28.320697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:28.321314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.321845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.322456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.323104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:28.361680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:28.435868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eee95-e9a8-449b-a1db-fdf893477c5c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:28.470071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:28.471565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:28.486326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:28.486974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.487247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.487511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.512992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:28.517737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:28.518734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:28.519564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 79/156] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:28.528551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:28.685655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 78/157] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:28.694835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:28.732614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:28.745983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2dd49-4d1d-4db5-862f-7e3b9d63ae84 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:28.749584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:28.837730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:28.838363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.838635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.838900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.839575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:28.840852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:28.842498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:28.864363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 80/158] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:28.878123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:28.878892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c1ab0-e310-4052-adb1-771383de62bb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:28.928626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:28.929746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:28.930216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:28.930670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:28.934689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:28.936608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:28.938514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 79/159] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:28 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:28.944761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:29.104874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:29.111322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925959f-e7c8-4bbe-8a41-1bcc758de74c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:29.112640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e00bf-8dfd-4a2f-895e-60c33cae0f68 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:29.195796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c5b4c-4eef-4cf5-9508-1b2dcb7539a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:29.197389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5b4c-4eef-4cf5-9508-1b2dcb7539a9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.198216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:29.198668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5b4c-4eef-4cf5-9508-1b2dcb7539a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.199433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.199833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5b4c-4eef-4cf5-9508-1b2dcb7539a9 None admin] PATH_INFO: `/v3/users/e2ef5869bc0645f193056c60370729ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.200876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.201292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.202049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c5b4c-4eef-4cf5-9508-1b2dcb7539a9 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef5869bc0645f193056c60370729ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:29.202999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=18066180735a47d6af84e13c7ce55ee2) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:29.204612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c5b4c-4eef-4cf5-9508-1b2dcb7539a9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:29.205091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:29.207617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f405e-9b53-4cf5-96dc-c875d6ef4f80 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:29.209658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 81/160] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:28 2022] GET /identity/v3/users/e2ef5869bc0645f193056c60370729ef => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:29.212072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd245-da02-4ee6-9ec8-bf73f8180762 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.212708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd245-da02-4ee6-9ec8-bf73f8180762 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.214085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd245-da02-4ee6-9ec8-bf73f8180762 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.215545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 82/161] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:29.216484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd245-da02-4ee6-9ec8-bf73f8180762 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:29.220213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 80/162] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:28 2022] GET /identity/v3/role_assignments?user.id=18066180735a47d6af84e13c7ce55ee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:29.223395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.223838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.225359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.266210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:29.269364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:29.274865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:29.383044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd245-da02-4ee6-9ec8-bf73f8180762 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:29.432112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:29.433123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.433534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.433934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.435009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 81/163] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:29.469831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:29.517303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:29.519360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:29.547281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:29.631901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 83/164] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:29.638795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:29.718780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:29.739173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fbbad-ff0b-418a-aa80-09a80d4eaf53 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:29.763545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee9ee-42f8-4c2f-a684-aa9141f6e487 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:29.789236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:29.805631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:29.806568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.807034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.807432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.808849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:29.810454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:29.812390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 84/165] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:29 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:29.819111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:29.825722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446586c-d787-43a5-8135-fa23014576be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:29.826515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446586c-d787-43a5-8135-fa23014576be None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.826898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446586c-d787-43a5-8135-fa23014576be None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.827271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446586c-d787-43a5-8135-fa23014576be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.838730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446586c-d787-43a5-8135-fa23014576be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-4446586c-d787-43a5-8135-fa23014576be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:29.843672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:29.844640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:29.845861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:29.847567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 82/166] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:29.853876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446586c-d787-43a5-8135-fa23014576be None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:29.947451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b8de-a369-450c-aa86-18cf9341671d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:29.987606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:29.988713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:29.989736 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:29.990267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:29.991254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=e2ef5869bc0645f193056c60370729ef) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:29.995801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:29.997517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:30.008213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 85/167] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:29 2022] GET /identity/v3/role_assignments?user.id=e2ef5869bc0645f193056c60370729ef&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:30.037150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446586c-d787-43a5-8135-fa23014576be None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:30.075858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:30.076767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.077207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.077600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.078416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:30.078848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:30.080484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9b626-e353-450c-a856-b381d035afc1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:30.092208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 83/168] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:30.098087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:30.182460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:30.233232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea716-fe77-4a96-b15d-b7e9f7737738 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:30.269463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:30.271267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480fc-3879-4039-bda4-37381103ad53 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.271545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480fc-3879-4039-bda4-37381103ad53 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.271808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480fc-3879-4039-bda4-37381103ad53 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.273376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 84/169] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:30.273901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.274171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.274430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.275584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:30.277052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:30.278924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 86/170] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:30 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:30.286517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.286784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.287052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.294252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:30.321187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:30.324730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:30.349547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:30.463917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 85/171] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:30.485580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb64a7-4b19-4dee-aba8-ce8b4b69d7ca None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:30.496921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:30.537561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:30.566879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95b868-583a-48dc-a9a2-a4aca919dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:30.567505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b868-583a-48dc-a9a2-a4aca919dc72 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.567779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b868-583a-48dc-a9a2-a4aca919dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.568044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b868-583a-48dc-a9a2-a4aca919dc72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.692439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b868-583a-48dc-a9a2-a4aca919dc72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:30.694006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b868-583a-48dc-a9a2-a4aca919dc72 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:30.704467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7d1db-621a-40c1-a59a-7198a229d85d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:30.741497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379991c-1465-4eab-9325-9b3d72f77a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:30.742187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379991c-1465-4eab-9325-9b3d72f77a75 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.742482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379991c-1465-4eab-9325-9b3d72f77a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.742860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379991c-1465-4eab-9325-9b3d72f77a75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.754753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379991c-1465-4eab-9325-9b3d72f77a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0379991c-1465-4eab-9325-9b3d72f77a75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:30.760322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:30.761234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:30.762106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:30.762715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 86/172] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:30.764391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3d69-d4da-4f81-bc15-06e2d634da9b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.764391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3d69-d4da-4f81-bc15-06e2d634da9b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.764554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3d69-d4da-4f81-bc15-06e2d634da9b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.765787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 87/173] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:30.770888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3d69-d4da-4f81-bc15-06e2d634da9b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:30.793430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:30.942116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 87/174] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:30.943459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:30.943743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:30.944010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:30.951318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3d69-d4da-4f81-bc15-06e2d634da9b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:30.978776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:30.979971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:31.015524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.019027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.019653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.019969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.020197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.020863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:31.021220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.022570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.040748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 88/175] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:31.041637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.110792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.112526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 88/176] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:31.119323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.193570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74364b96-cd58-427a-af06-160ab348e76b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.255025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.256149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.256427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.256691 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] PATH_INFO: `/v3/projects/a09a19716e25463b915cad90f4cc670d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.257913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] RBAC: Authorizing `identity:get_project(project_id=a09a19716e25463b915cad90f4cc670d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.258871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a5ec9-d423-438f-a119-733ef788ad50 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.259364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.261164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 89/177] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/projects/a09a19716e25463b915cad90f4cc670d => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:31.262136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.301083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d573-dd1a-413a-9df9-d1ba109bba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.302618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d573-dd1a-413a-9df9-d1ba109bba58 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.302957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d573-dd1a-413a-9df9-d1ba109bba58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.303289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d573-dd1a-413a-9df9-d1ba109bba58 None admin] PATH_INFO: `/v3/users/18066180735a47d6af84e13c7ce55ee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.304563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d573-dd1a-413a-9df9-d1ba109bba58 None admin] RBAC: Authorizing `identity:get_user(user_id=18066180735a47d6af84e13c7ce55ee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.306239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d573-dd1a-413a-9df9-d1ba109bba58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.308422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 89/178] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/users/18066180735a47d6af84e13c7ce55ee2 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:31.309646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df942f-072f-4d70-9fd6-44cb2fb2e17a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.309989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df942f-072f-4d70-9fd6-44cb2fb2e17a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.310326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df942f-072f-4d70-9fd6-44cb2fb2e17a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.311646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 90/179] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:31.316153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df942f-072f-4d70-9fd6-44cb2fb2e17a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.347145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.387314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882603d6-9573-4e31-b937-1c99a6b8469e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.424474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.425521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.426039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.426444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.429585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.433933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df942f-072f-4d70-9fd6-44cb2fb2e17a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.439230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:31.444710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:31.445782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:31.446656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 90/180] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:31.447316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.473761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.474612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.475048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.475449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.476437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=a09a19716e25463b915cad90f4cc670d, user.id=18066180735a47d6af84e13c7ce55ee2) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:31.476880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.478583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219131b-365b-4349-961e-a5e645aebefc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.485233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 91/181] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/role_assignments?user.id=18066180735a47d6af84e13c7ce55ee2&scope.project.id=a09a19716e25463b915cad90f4cc670d&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:31.486689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.487140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.487543 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.507698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:31.509167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:31.566534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030792f5-5d30-4309-b7ed-06205cdede4a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.587574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 92/182] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:31.589154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.608971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.627940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd140-32ba-4c22-8593-1a812ab1f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.628584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd140-32ba-4c22-8593-1a812ab1f326 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.628930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd140-32ba-4c22-8593-1a812ab1f326 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.629227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd140-32ba-4c22-8593-1a812ab1f326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.711136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.713033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4869337-b49b-4cda-b922-ef5ed98a9937 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.721449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd140-32ba-4c22-8593-1a812ab1f326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.723693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd140-32ba-4c22-8593-1a812ab1f326 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.754435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.755194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.755466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.756082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.756748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:31.757071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.758515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5756876-9910-4dfc-bae9-12029f0a08af None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.766686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 93/183] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:31.767910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2d6b-5d8b-4eb2-aa3b-97d8fe542864 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.768193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2d6b-5d8b-4eb2-aa3b-97d8fe542864 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.768491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2d6b-5d8b-4eb2-aa3b-97d8fe542864 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.769714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 94/184] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:31.770428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a2d6b-5d8b-4eb2-aa3b-97d8fe542864 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.827822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 91/185] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:31.829114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7273e-6658-4ca2-b275-956a3f8b19b0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.829450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7273e-6658-4ca2-b275-956a3f8b19b0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.829777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7273e-6658-4ca2-b275-956a3f8b19b0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.831055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 92/186] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:31.831739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7273e-6658-4ca2-b275-956a3f8b19b0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:31.857141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.879195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a2d6b-5d8b-4eb2-aa3b-97d8fe542864 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.911468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32915d74-c074-4792-8440-0a48cbd1b209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.912096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32915d74-c074-4792-8440-0a48cbd1b209 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.912369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32915d74-c074-4792-8440-0a48cbd1b209 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.912635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32915d74-c074-4792-8440-0a48cbd1b209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.922682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32915d74-c074-4792-8440-0a48cbd1b209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:31.926911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-32915d74-c074-4792-8440-0a48cbd1b209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:31.927864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:31.929082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:31.930363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 95/187] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:31.934627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7273e-6658-4ca2-b275-956a3f8b19b0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:31.935473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051e806-efe7-4faf-9635-155099f47118 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.935753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051e806-efe7-4faf-9635-155099f47118 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.936021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051e806-efe7-4faf-9635-155099f47118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.953680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b051e806-efe7-4faf-9635-155099f47118 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:31.954866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b051e806-efe7-4faf-9635-155099f47118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:31.979520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:31.980195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:31.980463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:31.980710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] PATH_INFO: `/v3/users/cc8535a8a69d4f6da42d8ce62b411989` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:31.981883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8535a8a69d4f6da42d8ce62b411989)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:31.983348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:31.985009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 93/188] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/users/cc8535a8a69d4f6da42d8ce62b411989 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:31.989723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.025220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 96/189] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:32.026608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.026887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.027148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.044009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:32.045243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:32.096156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572d777-30b3-4711-88cf-941c8701acd7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.106596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.112799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 97/190] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:32.115995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.138205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.138837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.139103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.139361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.140450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.141922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.143546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 94/191] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:31 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.144288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.174129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.215376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ff51-4d7a-40a4-af42-70ed77f9722a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.240297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a991e4d-5ed0-4ed7-9dd3-67dc8bc0fd4c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.248992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.249755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.250028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.250292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.250943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:32.251268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.252655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.260912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 98/192] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.262903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.278926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.279531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.279800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.280065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.322139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.350340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.351813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.365596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97c06-615e-4452-802f-5ab95afff595 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.383989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.400438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.401092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.401366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.401627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.411274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:32.416457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:32.417402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:32.418205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 99/193] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:32.418867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.461656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 95/194] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:32.461656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.519837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f92c3-e324-44c0-b54a-559ddcc09bff None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.539053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.552998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.553622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.553894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.554158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.555404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.556864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.557151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5efbe8-a3ab-4ad2-98d5-6e6e615a9f9c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.558463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 100/195] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.559322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.587120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.592336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.593043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.593319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.593583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.594304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] RBAC: Adding query filter params (role.id=137d83a6d55341aab18d66327415150f, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=18066180735a47d6af84e13c7ce55ee2) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:32.594606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.596059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.601887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 96/196] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/role_assignments?user.id=18066180735a47d6af84e13c7ce55ee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=137d83a6d55341aab18d66327415150f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.602600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.665060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19c7f-1ce2-43f5-97ed-7c73a99d10d2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.700845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.701746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.702021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.702282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] PATH_INFO: `/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.720303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] RBAC: Authorizing `identity:get_user(user_id=a1b9cec3c5844a0fb76f7932fddfbe12)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.722456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.723589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46620-fc2d-4ad0-a102-2e070544bd05 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.729432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 101/197] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.729432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.759869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.760607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.760879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.761169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.761839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:32.762137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.763516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.772784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 97/198] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.773628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.787993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.837907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:32.852608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b58ca-31b4-424e-9efe-cb38a408f38d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.878702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296f85-54ea-4894-9cca-caa7f4f04fff None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:32.886921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.887555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.887829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.888093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.889326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.890795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.892612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 102/199] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:32.893324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:32.912863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:32.913524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:32.913855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:32.914129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:32.914764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:32.916227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:32.936664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 98/200] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:32 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:32.937544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.000994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca5fd6-d4f1-4d5b-af6a-ce6734fc7c28 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.017864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.042602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.043218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.043458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.043734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.048454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52332-c03a-4636-a719-6bf544dcf386 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.064750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.090142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.090782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.091071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.091320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] PATH_INFO: `/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.092481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] RBAC: Authorizing `identity:get_user(user_id=a1b9cec3c5844a0fb76f7932fddfbe12)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.093979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.095799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 99/201] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:33.097827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.124431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.125874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.222404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83406-8756-4af7-aa1d-e6ca41ff628b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.251054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 103/202] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:33.252060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.261451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.262064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.262339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.262610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.263343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] RBAC: Adding query filter params (role.id=4cedf324d1e44684bad58ada65aff942, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799, user.id=cc8535a8a69d4f6da42d8ce62b411989) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:33.263654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.265135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.269081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.273547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 100/203] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:33 2022] GET /identity/v3/role_assignments?user.id=cc8535a8a69d4f6da42d8ce62b411989&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=4cedf324d1e44684bad58ada65aff942 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:33.274332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.337353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.399427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0962b-c17f-42f2-8b6c-38057b09bfd8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.401828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a01c8-31ed-4cee-9039-8c370da4730d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.446200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.446845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.447175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.447444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.454286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.454942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.455221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.456635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.460023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.463048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.464852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 101/204] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:33 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:33.471181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.551569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.553158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.589400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.589706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3e9a-51cf-4954-8fce-62441a1ac888 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.607722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.634871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.635727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.636135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.636564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.637467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=a1b9cec3c5844a0fb76f7932fddfbe12) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:33.637902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.639944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.647785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 102/205] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:33 2022] GET /identity/v3/role_assignments?user.id=a1b9cec3c5844a0fb76f7932fddfbe12&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:33.670871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 104/206] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:33.677198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.789245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e7904-0434-4e5b-ab9e-5526df7186b1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.828767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05a1d-61a5-40e4-ac56-07372411c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.829495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05a1d-61a5-40e4-ac56-07372411c65e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.829769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05a1d-61a5-40e4-ac56-07372411c65e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.830032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05a1d-61a5-40e4-ac56-07372411c65e None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.831327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05a1d-61a5-40e4-ac56-07372411c65e None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.832791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05a1d-61a5-40e4-ac56-07372411c65e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.834875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 103/207] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:33 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:33.840766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:33.946994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46e46b-d838-400b-af3f-9c0fe1ed7d53 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:33.961233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:33.981786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:33.982391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:33.982665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:33.982930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:33.983651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] RBAC: Adding query filter params (role.id=137d83a6d55341aab18d66327415150f, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=a1b9cec3c5844a0fb76f7932fddfbe12) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:33.983955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:33.985444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655bf0f-45eb-4302-b682-245177af4afc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:33.991616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 105/208] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:33 2022] GET /identity/v3/role_assignments?user.id=a1b9cec3c5844a0fb76f7932fddfbe12&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=137d83a6d55341aab18d66327415150f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:35.112607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a31f7-a92a-4445-839e-af4a9e3ed4ab None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.113161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a31f7-a92a-4445-839e-af4a9e3ed4ab None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.113161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a31f7-a92a-4445-839e-af4a9e3ed4ab None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.114725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 104/209] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:35.120164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e7bbf-70ac-4ff2-a01d-0101f5454c3f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.120576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e7bbf-70ac-4ff2-a01d-0101f5454c3f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.120761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e7bbf-70ac-4ff2-a01d-0101f5454c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.144014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9e3e7bbf-70ac-4ff2-a01d-0101f5454c3f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:35.145465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9e3e7bbf-70ac-4ff2-a01d-0101f5454c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:35.216211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 106/210] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:35.240493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a31f7-a92a-4445-839e-af4a9e3ed4ab None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.289316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:35.303831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070dbf2-9151-4581-8a2d-ff5c653b74a7 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.304112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070dbf2-9151-4581-8a2d-ff5c653b74a7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.304416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070dbf2-9151-4581-8a2d-ff5c653b74a7 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.306066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 107/211] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:35.310769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.311049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.311315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.329544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:35.330740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:35.348243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a31f7-a92a-4445-839e-af4a9e3ed4ab None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:35.382842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:35.383841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.384335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.384769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.395376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:35.400938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:35.401827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:35.402604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:35.403210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 108/212] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:35.405278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 105/213] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:35.411303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.423930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.461500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:35.514362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6cb2-32df-4c54-9019-ab73b3f65f9a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:35.524346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2654e27-0ffa-467a-91fb-2c5c8bea342f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:35.547666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:35.550747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:35.551429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.553311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.553311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.553311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:35.553311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:35.554524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:35.561537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:35.562398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.562836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.563264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.568901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:35.569060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 109/214] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:35.570059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.570946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:35.572722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 106/215] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:35.578323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.681561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:35.684576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0a35-83e5-488f-a853-23f130957b2f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:35.685671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55945b44-86c4-47be-9024-b06762db52bf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:35.721319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:35.721635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884b1e2-8ce9-4671-a98c-0806e65c73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:35.721941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.722204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b1e2-8ce9-4671-a98c-0806e65c73ba None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.722296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.722473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.722562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b1e2-8ce9-4671-a98c-0806e65c73ba None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.722744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b1e2-8ce9-4671-a98c-0806e65c73ba None admin] PATH_INFO: `/v3/users/6936359789cd4d2cb19b6649d30c3501` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.723124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:35.724581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:35.739233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884b1e2-8ce9-4671-a98c-0806e65c73ba None admin] RBAC: Authorizing `identity:get_user(user_id=6936359789cd4d2cb19b6649d30c3501)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:35.740857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884b1e2-8ce9-4671-a98c-0806e65c73ba None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:35.743018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 110/216] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:35 2022] GET /identity/v3/users/6936359789cd4d2cb19b6649d30c3501 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:35.748387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 107/217] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:35 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:57:35.749072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70eb9-7783-46c5-8ca7-e6d0e9e471f6 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.749355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70eb9-7783-46c5-8ca7-e6d0e9e471f6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.749627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70eb9-7783-46c5-8ca7-e6d0e9e471f6 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.749934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.754879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 111/218] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:35.757173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.757645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.758050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:35.777757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:35.779319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:35.793736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:35.860445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 112/219] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:35.883023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:35.883561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59e5a-1afb-40f9-99d0-ad3e67d31725 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:35.928135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225831f-3d57-4f12-aceb-63078c6b3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:35.928785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225831f-3d57-4f12-aceb-63078c6b3fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:35.929090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225831f-3d57-4f12-aceb-63078c6b3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:35.929408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225831f-3d57-4f12-aceb-63078c6b3fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.002328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.013632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225831f-3d57-4f12-aceb-63078c6b3fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.015213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225831f-3d57-4f12-aceb-63078c6b3fc5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.015973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759a807-c8af-49a1-b681-557fe0ab6685 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.050653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.058886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf39927-035d-4b36-b0b9-6b95749debe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.059740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf39927-035d-4b36-b0b9-6b95749debe2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.060183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf39927-035d-4b36-b0b9-6b95749debe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.060583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf39927-035d-4b36-b0b9-6b95749debe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.075450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf39927-035d-4b36-b0b9-6b95749debe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-daf39927-035d-4b36-b0b9-6b95749debe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:36.080311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:36.081259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 113/220] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:36.082788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1ee2-edf3-4022-951e-e87cbd8c6349 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.083501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1ee2-edf3-4022-951e-e87cbd8c6349 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.083501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1ee2-edf3-4022-951e-e87cbd8c6349 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.084765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 114/221] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:36.091038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1ee2-edf3-4022-951e-e87cbd8c6349 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.139681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 108/222] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:36.141064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.141345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.141707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.160367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:36.161719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:36.209123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1ee2-edf3-4022-951e-e87cbd8c6349 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.243989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 109/223] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:36.249255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.257093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.258184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.258757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.259203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.260053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:36.260535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.262151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.271506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 115/224] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:36.272848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.287498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.326687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.384430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e18b0-42e9-499c-9bdc-5f343dbf473c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.385561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66a2e-ba16-4861-9fd2-7c74a940e84d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.420337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.420935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.421238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.421502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.429754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.430599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.431192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.431754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.431903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:36.433221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.434842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.436672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 110/225] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:36.437676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:36.438299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:36.439154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:36.439945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 116/226] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:36.445288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.523110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.563100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58ca9-2ba4-4dc6-a9d8-a48d04d37844 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.571837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1f06a-4b73-49f1-b34e-83e37c418c0b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.605213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.606895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.608141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.609356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.610303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.611898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=6936359789cd4d2cb19b6649d30c3501) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:36.612404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.614056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.616619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.618027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.618747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.619187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] PATH_INFO: `/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.620494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=a1b9cec3c5844a0fb76f7932fddfbe12)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.620618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 117/227] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/role_assignments?user.id=6936359789cd4d2cb19b6649d30c3501&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:36.621503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.622533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.626073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:36.637100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.758403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93bebe-fbf6-47a0-9db7-fe8b2c3e6eb5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.804813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.805538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.805870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.806190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.808082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.809896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.811874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 112/229] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:36.817653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.832152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1599-6f2e-4d68-9429-c0db867d1420 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.895014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.895630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.895904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.896173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.896836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:36.897161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.898607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:36.900092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.907365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:36.923435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 118/230] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:36.928553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:36.948880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd27c-9901-443c-b86b-a7e2be143d66 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:36.991478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:36.992385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:36.992658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:36.992929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde/users/a1b9cec3c5844a0fb76f7932fddfbe12/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:36.998247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=93886058307e40e88cba52acb7c07fde, user_id=a1b9cec3c5844a0fb76f7932fddfbe12, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:36.999721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:37.025183 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:36 2022] PUT /identity/v3/projects/93886058307e40e88cba52acb7c07fde/users/a1b9cec3c5844a0fb76f7932fddfbe12/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:57:37.078239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fd00b-ccc6-41a8-850c-ae62d13a73ff None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:37.132714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:37.133396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:37.133666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:37.133927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] PATH_INFO: `/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:37.137695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] RBAC: Authorizing `identity:get_user(user_id=a1b9cec3c5844a0fb76f7932fddfbe12)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:37.139166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:37.141174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 119/232] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:36 2022] GET /identity/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:37.146989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:37.313371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95393a7-5870-4192-acf2-6e4401729ed8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:37.338628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:37.356237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb33d3-0934-4297-af30-9aab215fed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:37.356887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb33d3-0934-4297-af30-9aab215fed6f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:37.357212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb33d3-0934-4297-af30-9aab215fed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:37.357469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb33d3-0934-4297-af30-9aab215fed6f None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:37.358783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb33d3-0934-4297-af30-9aab215fed6f None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:37.360451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb33d3-0934-4297-af30-9aab215fed6f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:37.362306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 114/233] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:37 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:37.368281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:37.470829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:37.524630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4323-5737-4238-be49-a469f3f4d689 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:37.568276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdacc0-962c-46d8-8562-922df1d2f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:37.569331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdacc0-962c-46d8-8562-922df1d2f908 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:37.569801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdacc0-962c-46d8-8562-922df1d2f908 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:37.570351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdacc0-962c-46d8-8562-922df1d2f908 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde/users/a1b9cec3c5844a0fb76f7932fddfbe12/roles/137d83a6d55341aab18d66327415150f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:37.572653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdacc0-962c-46d8-8562-922df1d2f908 None admin] RBAC: Authorizing `identity:create_grant(project_id=93886058307e40e88cba52acb7c07fde, user_id=a1b9cec3c5844a0fb76f7932fddfbe12, role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:37.574348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdacc0-962c-46d8-8562-922df1d2f908 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:37.600622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 120/234] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:37 2022] PUT /identity/v3/projects/93886058307e40e88cba52acb7c07fde/users/a1b9cec3c5844a0fb76f7932fddfbe12/roles/137d83a6d55341aab18d66327415150f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:38.148525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e00167-b4d8-4d99-9e2d-b5678988099e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.149045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e00167-b4d8-4d99-9e2d-b5678988099e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.149150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e00167-b4d8-4d99-9e2d-b5678988099e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.150711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 115/235] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:38.155797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40096be-f769-4acb-a3de-858ca5481af6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.156077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40096be-f769-4acb-a3de-858ca5481af6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.156346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40096be-f769-4acb-a3de-858ca5481af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.180575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a40096be-f769-4acb-a3de-858ca5481af6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:38.181774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a40096be-f769-4acb-a3de-858ca5481af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:38.264242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:38.286037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e00167-b4d8-4d99-9e2d-b5678988099e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:38.357954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5422c-797c-4498-bada-9bd6f856534c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.358299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5422c-797c-4498-bada-9bd6f856534c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.358484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5422c-797c-4498-bada-9bd6f856534c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.359832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 122/237] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:38.371471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.372034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.372034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.403155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:38.404246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:38.462848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e00167-b4d8-4d99-9e2d-b5678988099e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:38.505383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:38.532466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:38.533133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.533394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.533665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.537554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 123/238] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 10:57:38.561768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:38.564253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:38.569087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:38.569994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:38.570785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:38.575169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 116/239] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:38.577959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:38.663275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39e8d9-4029-47f7-ac73-de05cd081761 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:38.679136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:38.698749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:38.699441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.699717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.699980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.701087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:38.702833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:38.704794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 124/240] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:38.710240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:38.768073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b047-0554-47cb-9829-e48483004e09 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:38.768740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:38.810091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d82e45-f6a8-4335-af1d-ffde4b66a40f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:38.838213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:38.838847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.839118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.839395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.840059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:38.840358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:38.841783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:38.844137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36438f4c-5f30-4a3a-a596-6a661ba332e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:38.844737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36438f4c-5f30-4a3a-a596-6a661ba332e1 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:38.845026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36438f4c-5f30-4a3a-a596-6a661ba332e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:38.845293 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36438f4c-5f30-4a3a-a596-6a661ba332e1 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:38.845933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36438f4c-5f30-4a3a-a596-6a661ba332e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:38.847359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36438f4c-5f30-4a3a-a596-6a661ba332e1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:38.858865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 117/241] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:38.864710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:38.882513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 125/242] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:38 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:57:39.011533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1615f-a9f7-4b93-aeae-0144dbfb5ce4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.031562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:39.058488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea8db-ea82-45bc-8597-9645ff17458f None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.058804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea8db-ea82-45bc-8597-9645ff17458f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.059027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea8db-ea82-45bc-8597-9645ff17458f None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.060415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 126/243] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:39.067590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.067933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.068136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.081825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.082480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.082806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.083080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] PATH_INFO: `/v3/users/7e41b606d4bd4397943425be7512155a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.098870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:39.100133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:39.108434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] RBAC: Authorizing `identity:get_user(user_id=7e41b606d4bd4397943425be7512155a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:39.110017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:39.112107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 118/244] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:38 2022] GET /identity/v3/users/7e41b606d4bd4397943425be7512155a => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:39.119157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.184203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 127/245] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:39.207760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.232504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7b634-0f3c-41aa-ac1e-44e391320eaa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.267923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:39.277467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.278305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.278717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.279116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.342484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:39.347990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3b96-8f2e-4a48-b06c-7b0068c1db75 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.372218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:39.374024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:39.392295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.393006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.393313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.393628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.407600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:39.413596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:39.414702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:39.415760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 128/246] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:39.424262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.505585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 119/247] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:39.512274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.541691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:39.546908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af3ec0-9ea9-4ca6-9b58-7db296338686 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.605391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:39.626056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374cff9-cd14-4b5b-b683-297ec1569a04 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.636807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.637452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.637727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.637987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.638655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:39.638946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:39.640371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:39.658027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 129/248] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:39.668568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.669879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.670534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.670811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.671078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.672206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:39.673693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:39.675617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 120/249] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:39.698546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.826856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9d10-c945-46ed-9745-b1e8eb043c26 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.875394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42817fd-268d-4383-8d6c-24f8c654cb5c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:39.905734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a87a4d-fefa-4c2e-a0a4-dec1178beb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.906433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87a4d-fefa-4c2e-a0a4-dec1178beb2f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.906715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87a4d-fefa-4c2e-a0a4-dec1178beb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.906981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87a4d-fefa-4c2e-a0a4-dec1178beb2f None admin] PATH_INFO: `/v3/users/6936359789cd4d2cb19b6649d30c3501` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.912286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a87a4d-fefa-4c2e-a0a4-dec1178beb2f None admin] RBAC: Authorizing `identity:get_user(user_id=6936359789cd4d2cb19b6649d30c3501)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:39.913894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a87a4d-fefa-4c2e-a0a4-dec1178beb2f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:39.915548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 130/250] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/users/6936359789cd4d2cb19b6649d30c3501 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:39.916702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a637-be2f-49b7-a8c0-44abc899acf5 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.916999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a637-be2f-49b7-a8c0-44abc899acf5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.917267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a637-be2f-49b7-a8c0-44abc899acf5 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.918442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 131/251] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:39.934722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a637-be2f-49b7-a8c0-44abc899acf5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:39.947256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:39.947877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.948148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.948407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:39.949181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] RBAC: Adding query filter params (role.id=4cedf324d1e44684bad58ada65aff942, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=7e41b606d4bd4397943425be7512155a) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:39.949485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:39.950937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea1b1a-873a-4c6e-9e78-142e1cb17260 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:39.965835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 121/252] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/role_assignments?user.id=7e41b606d4bd4397943425be7512155a&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=4cedf324d1e44684bad58ada65aff942 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:39.967308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:39.967586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:39.967855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.001371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:40.006238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:40.007478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:40.011978 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:40.162652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a637-be2f-49b7-a8c0-44abc899acf5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:40.163641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 122/253] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:40.199114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:40.216127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f65ac-c821-4c2b-8c7a-6cd1e374b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:40.217022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f65ac-c821-4c2b-8c7a-6cd1e374b854 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.217437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f65ac-c821-4c2b-8c7a-6cd1e374b854 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.218015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f65ac-c821-4c2b-8c7a-6cd1e374b854 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.219302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f65ac-c821-4c2b-8c7a-6cd1e374b854 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:40.220927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f65ac-c821-4c2b-8c7a-6cd1e374b854 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:40.223183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 132/254] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:39 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:40.224619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f742-9343-4cd1-8035-cc596cc97d46 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.225176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f742-9343-4cd1-8035-cc596cc97d46 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.225448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f742-9343-4cd1-8035-cc596cc97d46 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.226865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 133/255] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:40.231729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f742-9343-4cd1-8035-cc596cc97d46 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:40.375056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0788-a3e1-4344-b5cb-8a2028690bb8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:40.393463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:40.408749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f742-9343-4cd1-8035-cc596cc97d46 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:40.439189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f431bc-6a67-4a3e-963f-15053e7477b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:40.439825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f431bc-6a67-4a3e-963f-15053e7477b7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.440099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f431bc-6a67-4a3e-963f-15053e7477b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.440364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f431bc-6a67-4a3e-963f-15053e7477b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.449354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:40.460250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:40.460957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.461358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.461639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde/users/6936359789cd4d2cb19b6649d30c3501/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.463776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=93886058307e40e88cba52acb7c07fde, user_id=6936359789cd4d2cb19b6649d30c3501, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:40.465276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:40.473860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f431bc-6a67-4a3e-963f-15053e7477b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-92f431bc-6a67-4a3e-963f-15053e7477b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:40.484885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:40.485803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 123/256] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:40.486611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.487320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.487320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.498878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 134/257] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:40 2022] PUT /identity/v3/projects/93886058307e40e88cba52acb7c07fde/users/6936359789cd4d2cb19b6649d30c3501/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:40.501679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:40.523069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:40.526051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:40.659427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 124/258] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:40.693795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218cb-1ab4-475d-ad9d-b95e94489d84 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:40.736844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:40.761859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:40.763731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.764163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.766403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.767315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:40.767763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:40.774123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:40.790065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 135/259] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:40.797474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:40.852440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:40.886559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13402727-dd8a-460f-b16a-4a26035066e9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:40.918074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:40.939962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:40.941025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:40.941526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:40.942111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:40.962525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:40.968804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:40.969748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:40.970562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 125/260] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:40.983002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:41.025759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa52f-912e-4375-b2b2-6d580920f39c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:41.104001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:41.104656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:41.104930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:41.105222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] PATH_INFO: `/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:41.109694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a1b9cec3c5844a0fb76f7932fddfbe12)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:41.111190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:41.112812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 136/261] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:40 2022] GET /identity/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12 => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:41.121000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:41.185321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5832c3-83e0-48a9-a9e3-277fc0b28c0b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:41.239961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:41.240585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:41.240858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:41.241197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:41.242329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:41.242640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:41.244202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:41.259654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 126/262] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:41.265670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:41.339588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:41.354102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:41.391145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727d57d-6bf4-47b7-949b-ed4ca4d7b9b1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:41.401062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107f37e-3341-4c9f-8083-6233319039a6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:41.441065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:41.442037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:41.442527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:41.443120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] PATH_INFO: `/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:41.445640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] RBAC: Authorizing `identity:get_user(user_id=a1b9cec3c5844a0fb76f7932fddfbe12)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:41.448414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:41.450498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 127/263] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:41 2022] GET /identity/v3/users/a1b9cec3c5844a0fb76f7932fddfbe12 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:41.458724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:41.483682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:41.485804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:41.486608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:41.488291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:41.603730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:41.605270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:41.674293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712ea1-51ca-47a0-89f7-ae0559b7ff8e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:41.698411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:41.737710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173b15-9bee-43ee-a437-b10ffb545dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:41.738335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173b15-9bee-43ee-a437-b10ffb545dec None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:41.738612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173b15-9bee-43ee-a437-b10ffb545dec None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:41.738879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173b15-9bee-43ee-a437-b10ffb545dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:41.793800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:41.832264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 137/264] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 10:57:41.837957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:41.880954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173b15-9bee-43ee-a437-b10ffb545dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:41.884084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173b15-9bee-43ee-a437-b10ffb545dec None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.015443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfec14-98fc-4d15-9e82-5a1844c33068 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.055153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 128/265] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:42.056507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216294-d065-4872-ab7d-96e576b2d716 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.056875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216294-d065-4872-ab7d-96e576b2d716 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.057065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216294-d065-4872-ab7d-96e576b2d716 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.058550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 129/266] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:42.059619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570fa1-965d-4f1b-bc6a-6d049b9ee145 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.059793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.059904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570fa1-965d-4f1b-bc6a-6d049b9ee145 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.060142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570fa1-965d-4f1b-bc6a-6d049b9ee145 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.060386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.060668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.060934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.061390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 130/267] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:42.062659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:42.064219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.066123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 138/268] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:41 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:42.066974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.067086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b74a-ff24-44c6-a850-c24b1d25d943 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.067345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b74a-ff24-44c6-a850-c24b1d25d943 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.067662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b74a-ff24-44c6-a850-c24b1d25d943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.086640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2569b74a-ff24-44c6-a850-c24b1d25d943 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:42.088096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2569b74a-ff24-44c6-a850-c24b1d25d943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:42.103546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:42.134894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:42.162746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 131/269] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:42.164358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.164729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.165134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.192624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:42.193832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:42.200502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51c0f-e534-4d75-82e5-efb747f56e2b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.236449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.237191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.237576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.237870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.239022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:42.240584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.247148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 139/270] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:42.247148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.285113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 132/271] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:42.286045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.369479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471cb11-d109-401c-9b89-cd748490b04b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.384887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:42.396862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:42.411227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.412173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.412883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.413595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.414486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=a1b9cec3c5844a0fb76f7932fddfbe12) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:42.415074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:42.417259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.418725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d1495-abae-4b7a-8b54-9cc87514e042 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.427483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 140/272] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/role_assignments?user.id=a1b9cec3c5844a0fb76f7932fddfbe12&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:42.428622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.485954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.486905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.488344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.488785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.490190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:42.491859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.494526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 133/273] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:42.495628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.625876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5c907-2daa-4640-90db-4f1f8d5a2a3b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.635041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ac46-adc0-4f01-832f-1f1c9280a522 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.674078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe73ae-8afe-4460-8f09-be51b79fd198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.674724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe73ae-8afe-4460-8f09-be51b79fd198 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.674994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe73ae-8afe-4460-8f09-be51b79fd198 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.675256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe73ae-8afe-4460-8f09-be51b79fd198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.677288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.677957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.678296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.678840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.679615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] RBAC: Adding query filter params (role.id=137d83a6d55341aab18d66327415150f, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=a1b9cec3c5844a0fb76f7932fddfbe12) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:42.679915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:42.681393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.687592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe73ae-8afe-4460-8f09-be51b79fd198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:42.689012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 141/274] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/role_assignments?user.id=a1b9cec3c5844a0fb76f7932fddfbe12&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=137d83a6d55341aab18d66327415150f => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:42.689886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f2fe73ae-8afe-4460-8f09-be51b79fd198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:42.697431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:42.698442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:42.699230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:42.701922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 134/275] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:42.703555 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3aca-66e2-45f0-87de-9e6fcde7240b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.704091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3aca-66e2-45f0-87de-9e6fcde7240b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.704553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3aca-66e2-45f0-87de-9e6fcde7240b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.706290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 135/276] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:42.712378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.713039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.713572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.722055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:42.737198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:42.739012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:42.762863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:42.821382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 136/277] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:42.822615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.823715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b471b0-5432-4023-a9b4-4dc594d2c6dd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:42.862337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:42.863149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:42.863331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:42.863702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:42.868386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:42.868386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:42.895563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 142/278] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:57:42 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:42.897042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:42.968093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b75cf3-2219-4a05-b4bf-e94fa850b7cd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.006240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:43.012414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.013451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.013958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.014425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.015390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:43.015944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:43.017612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:43.018595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88906a1-2f7c-42e3-9865-38ada14b8400 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.026970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:43.029291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 137/279] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:43.038986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.074629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.075747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.076251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.076719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.091421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:43.097555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:43.098458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:43.099241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:43.101566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 143/280] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:43.108957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.172684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2e6a-4fa3-4225-8c73-d6047716416e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.228583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.229283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.229558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.229821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] PATH_INFO: `/v3/users/12c51f86aef345a9bb48c75d2c557ee0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.251526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=12c51f86aef345a9bb48c75d2c557ee0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:43.253621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:43.256190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 138/281] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/users/12c51f86aef345a9bb48c75d2c557ee0 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:43.257256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef148d28-d5b2-4dd2-8803-af2787d38e5e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.262928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.301765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.302377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.302698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.302955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.303557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:43.303849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:43.305341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:43.315361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 144/282] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:43.320265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.329040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:43.359231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:43.390048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aab63-1551-496b-9d52-44b7aa241fc5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.436192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.437150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.437689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.437962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.438939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, user.id=12c51f86aef345a9bb48c75d2c557ee0, scope.system=all) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:43.439644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:43.441408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab382f7-b103-4e76-8c86-916b53a7c7c5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:43.442142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed8030-c597-47c3-91a7-fa7bc2a6908a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.448237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 139/283] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/role_assignments?user.id=12c51f86aef345a9bb48c75d2c557ee0&scope.system=all&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:43.449495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28cc8b-bace-4321-a7eb-cbc8b81d8b2b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.450318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28cc8b-bace-4321-a7eb-cbc8b81d8b2b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.450597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28cc8b-bace-4321-a7eb-cbc8b81d8b2b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.452493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 140/284] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:43.458249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.458581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.458778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.492181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:43.493198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.493408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:43.493965 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.494307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.494629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] PATH_INFO: `/v3/users/7e41b606d4bd4397943425be7512155a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.495913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] RBAC: Authorizing `identity:get_user(user_id=7e41b606d4bd4397943425be7512155a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:43.497495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:43.499584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 145/285] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/users/7e41b606d4bd4397943425be7512155a => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:43.511830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.578348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 141/286] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:43.602817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.668651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:43.682682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:43.693838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2aef1-a7f5-4fd1-a56f-87f2bf2b51a0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.733858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4971bc-0263-4009-98fd-a626abda6dba None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.762947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.764046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.764517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.765056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.766513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:43.768284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:43.770549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 146/287] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:43.772165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:43.772165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:43.772165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:43.772429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:43.776027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.797753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:43.804075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:43.805056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:43.805901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:43.810723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:43.817818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:43.969650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206f1bf-9ab5-4749-8c2e-d41cbe19b5cc None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:43.998729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7b6b3-0e7c-4cb1-85b5-c14edb1c20ca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:44.016129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:44.029614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:44.030292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:44.030569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:44.030841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde/users/7e41b606d4bd4397943425be7512155a/roles/4cedf324d1e44684bad58ada65aff942` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:44.032767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=93886058307e40e88cba52acb7c07fde, user_id=7e41b606d4bd4397943425be7512155a, role_id=4cedf324d1e44684bad58ada65aff942)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:44.034298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:44.052497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 147/289] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:57:43 2022] PUT /identity/v3/projects/93886058307e40e88cba52acb7c07fde/users/7e41b606d4bd4397943425be7512155a/roles/4cedf324d1e44684bad58ada65aff942 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:57:44.066145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:44.066892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:44.067234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:44.067570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:44.068354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:44.068760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:44.070357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:44.081180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:44.090177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:44.126412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:44.218922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514457-dc40-4aba-9018-6dee6bd039d4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:44.256157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:44.256804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:44.257109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:44.257498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] PATH_INFO: `/v3/users/6936359789cd4d2cb19b6649d30c3501` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:44.258694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] RBAC: Authorizing `identity:get_user(user_id=6936359789cd4d2cb19b6649d30c3501)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:44.260159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:44.262299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 148/291] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:44 2022] GET /identity/v3/users/6936359789cd4d2cb19b6649d30c3501 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:44.270317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:44.384328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07964a24-98be-4b8f-8f36-346cb9d1b2c6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:44.422740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:44.423388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:44.423657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:44.423932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:44.462392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:44.510086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:44.511482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:44.641103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:44.646092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:44.770679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:44.786034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d0af-c5a6-4edb-acce-77bdbee65805 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:44.831995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5182c7-f45e-4236-bfb5-7cc08e2b92bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:44.832665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5182c7-f45e-4236-bfb5-7cc08e2b92bd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:44.832920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5182c7-f45e-4236-bfb5-7cc08e2b92bd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:44.833237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5182c7-f45e-4236-bfb5-7cc08e2b92bd None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:44.834381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5182c7-f45e-4236-bfb5-7cc08e2b92bd None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:44.835900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5182c7-f45e-4236-bfb5-7cc08e2b92bd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:44.837877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 149/293] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:44 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:44.843846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:44.938275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:44.972747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024eab1-c349-451e-a462-c77cc4978680 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:45.012448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:45.013441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.013929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.014392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.015295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=6936359789cd4d2cb19b6649d30c3501) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:45.015780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:45.017422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4a8e-474f-4929-a392-d516d4c95083 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:45.029099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 145/294] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:44 2022] GET /identity/v3/role_assignments?user.id=6936359789cd4d2cb19b6649d30c3501&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:45.627379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed2f4-65f7-46e8-aa81-40c46472a189 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.627773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed2f4-65f7-46e8-aa81-40c46472a189 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.627960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed2f4-65f7-46e8-aa81-40c46472a189 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.629462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 150/295] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:45.637068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badf384-9e4d-42e4-b82a-1db481d165f2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.637947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badf384-9e4d-42e4-b82a-1db481d165f2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.638465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badf384-9e4d-42e4-b82a-1db481d165f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.644049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fe0ec-b5d2-4d20-8375-2befa0e2c563 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.644324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fe0ec-b5d2-4d20-8375-2befa0e2c563 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.644589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fe0ec-b5d2-4d20-8375-2befa0e2c563 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.647158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 151/296] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:45.654550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.654737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.654923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.661992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0badf384-9e4d-42e4-b82a-1db481d165f2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:45.663129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0badf384-9e4d-42e4-b82a-1db481d165f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:45.682234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:45.683715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:45.751026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 146/297] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:45.757276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc01c-272d-4a81-aaa1-51840ea1960d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.757276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc01c-272d-4a81-aaa1-51840ea1960d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.757276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc01c-272d-4a81-aaa1-51840ea1960d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.757478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 147/298] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:45.762658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.762934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.763294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.774733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 152/299] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:45.777961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:45.784004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:45.785203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:45.845354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:45.861206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 148/300] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:45.861206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:45.882643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:45.893982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14caa-3cee-4734-a49c-fc1baceb3b6e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:45.928412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:45.929089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:45.929366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:45.929629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:45.940262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:45.945028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:45.946055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 153/301] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:45.951706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:45.968385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a66d9-e5f1-439e-ab79-0aaf497d4473 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.002224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.002858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.003126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.003389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.004462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.006294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.012784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 149/302] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:46.012784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.050106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949a3f-e7e7-48c5-b082-90c291b1ccd0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.077690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.083960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.084587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.084854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.085148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.095303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:46.100001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:46.100862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:46.102078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:46.106068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 154/303] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:46.106884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.120026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.129818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443b30-516b-4386-a38d-6f1cca670057 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.167634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.168237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.168501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.168785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.169554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:46.169876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.171332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.180704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 150/304] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:46.181453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.217076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512f22-1860-4f6b-a391-5865b8aee3a3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.249944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.250554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.250819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.251078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] PATH_INFO: `/v3/groups` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.251694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.253177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.271536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 155/305] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 10 10:57:46 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:57:46.272599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.298912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208707b-f24f-435a-aa8b-cc3c58a2e574 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.336430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.349489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.350109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.350381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.350646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.351500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:46.351836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.353291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.367717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 151/306] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:46.368840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.379903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.421327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0ace9-4ef7-46ac-bc13-abab4d3e064e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.462299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c23159-e8ed-40e6-a1a7-25c3b3beb03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.462936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23159-e8ed-40e6-a1a7-25c3b3beb03d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.463204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23159-e8ed-40e6-a1a7-25c3b3beb03d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.463471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23159-e8ed-40e6-a1a7-25c3b3beb03d None admin] PATH_INFO: `/v3/users/708b8ef6701d4be59140f13470f5e888` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.478927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c23159-e8ed-40e6-a1a7-25c3b3beb03d None admin] RBAC: Authorizing `identity:get_user(user_id=708b8ef6701d4be59140f13470f5e888)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.480394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c23159-e8ed-40e6-a1a7-25c3b3beb03d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.482314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 156/307] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/users/708b8ef6701d4be59140f13470f5e888 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:46.483349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6ac9-618e-4c0b-a6d7-7a53aa923027 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.483536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6ac9-618e-4c0b-a6d7-7a53aa923027 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.483636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08ae4-105e-4c60-b02a-b357ae97a147 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.483800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6ac9-618e-4c0b-a6d7-7a53aa923027 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.485203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 157/308] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:46.492131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6ac9-618e-4c0b-a6d7-7a53aa923027 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.519460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1826-8582-4ad2-9f1b-27d7bfe402ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.520160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1826-8582-4ad2-9f1b-27d7bfe402ad None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.520365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1826-8582-4ad2-9f1b-27d7bfe402ad None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.520631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1826-8582-4ad2-9f1b-27d7bfe402ad None admin] PATH_INFO: `/v3/users/12c51f86aef345a9bb48c75d2c557ee0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.521891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c1826-8582-4ad2-9f1b-27d7bfe402ad None admin] RBAC: Authorizing `identity:get_user(user_id=12c51f86aef345a9bb48c75d2c557ee0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.523390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c1826-8582-4ad2-9f1b-27d7bfe402ad None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.525005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 152/309] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/users/12c51f86aef345a9bb48c75d2c557ee0 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:46.526116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.526392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.526662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.544844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:46.546043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:46.596025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.599132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6ac9-618e-4c0b-a6d7-7a53aa923027 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.621064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 153/310] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:46.621064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.633274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.643976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.644581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.644845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.645137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.645855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] RBAC: Adding query filter params (role.id=4cedf324d1e44684bad58ada65aff942, user.id=708b8ef6701d4be59140f13470f5e888, scope.system=all) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:46.646152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.647580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.653052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 158/311] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/role_assignments?user.id=708b8ef6701d4be59140f13470f5e888&scope.system=all&role.id=4cedf324d1e44684bad58ada65aff942 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:46.655452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.744964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6244-2c4d-4547-98d4-7680254e469d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.784926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f3263-8c5c-4b26-ada1-0c802bb3f9da None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:46.788213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.789103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.789476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.789840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] PATH_INFO: `/v3/system/users/12c51f86aef345a9bb48c75d2c557ee0/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.791398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12c51f86aef345a9bb48c75d2c557ee0, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:46.792901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:46.803749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 154/312] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 10 10:57:46 2022] PUT /identity/v3/system/users/12c51f86aef345a9bb48c75d2c557ee0/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:46.832591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:46.833572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:46.834006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:46.834420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:46.846955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:46.851893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:46.852815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:46.854128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 159/313] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:46.859977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:46.915600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:46.977968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ab08e-e2cd-4e5b-a1d0-671cd8226151 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:47.013086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:47.013628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:47.013905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:47.014168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:47.014838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:47.015134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:47.016505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:47.025804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 155/314] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:47.031374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:47.087095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:47.137162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57013-0c81-44b3-9f6d-737d05de68b6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:47.173762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:47.174395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:47.174665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:47.174927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] PATH_INFO: `/v3/users/7e41b606d4bd4397943425be7512155a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:47.176039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] RBAC: Authorizing `identity:get_user(user_id=7e41b606d4bd4397943425be7512155a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:47.177519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:47.179557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 160/315] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:47 2022] GET /identity/v3/users/7e41b606d4bd4397943425be7512155a => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:47.185014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:47.291281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83d6c-4316-4784-bcbf-096cda2c48f4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:47.300644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:47.326566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:47.327180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:47.327458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:47.327727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:47.396972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:47.398618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:47.502158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 156/316] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:47.508100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:47.609581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dceec0-4216-472f-a4dc-7c111b35b170 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:47.633527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:47.647981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4844fd7-5ddf-4a71-b170-1683d7feb2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:47.649599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4844fd7-5ddf-4a71-b170-1683d7feb2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:47.650017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4844fd7-5ddf-4a71-b170-1683d7feb2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:47.650417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4844fd7-5ddf-4a71-b170-1683d7feb2e4 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:47.651646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4844fd7-5ddf-4a71-b170-1683d7feb2e4 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:47.653265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4844fd7-5ddf-4a71-b170-1683d7feb2e4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:47.655373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 161/317] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:47 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:47.661181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:47.671653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:47.769962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5db7-df10-43b1-b674-5692124b308f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:47.804649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:47.805296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:47.805578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:47.805847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:47.806576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] RBAC: Adding query filter params (role.id=4cedf324d1e44684bad58ada65aff942, scope.project.id=93886058307e40e88cba52acb7c07fde, user.id=7e41b606d4bd4397943425be7512155a) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:47.806877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:47.808310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfab64-3e50-4d4a-b7a9-acbac6e1d543 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:47.814662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 157/318] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:57:47 2022] GET /identity/v3/role_assignments?user.id=7e41b606d4bd4397943425be7512155a&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=4cedf324d1e44684bad58ada65aff942 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:48.357203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaac88-722e-458b-a587-f209e86e76ba None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.357775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaac88-722e-458b-a587-f209e86e76ba None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.357775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaac88-722e-458b-a587-f209e86e76ba None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.359238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 162/319] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:48.364263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.364544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.364822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.383565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:48.384687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:48.455676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 158/320] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:48.477794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaac88-722e-458b-a587-f209e86e76ba None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:48.580800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaac88-722e-458b-a587-f209e86e76ba None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:48.619033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4394-7426-42ac-96d6-929c9ad58928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:48.619664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4394-7426-42ac-96d6-929c9ad58928 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.619936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4394-7426-42ac-96d6-929c9ad58928 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.620198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4394-7426-42ac-96d6-929c9ad58928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.621420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4394-7426-42ac-96d6-929c9ad58928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:48.622858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4394-7426-42ac-96d6-929c9ad58928 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:48.624675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 163/321] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:48.631256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:48.633756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:48.718492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f810d-635d-41df-bf2e-df2711ab576b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.718809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f810d-635d-41df-bf2e-df2711ab576b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.719064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f810d-635d-41df-bf2e-df2711ab576b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.720538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 164/322] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:48.725541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0528-bf63-4010-b082-f412d0972e9a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.725815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0528-bf63-4010-b082-f412d0972e9a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.726154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0528-bf63-4010-b082-f412d0972e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.734587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a185c6-82e0-43ff-9194-0cd3aad07947 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:48.744572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cb7c0528-bf63-4010-b082-f412d0972e9a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:48.745795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cb7c0528-bf63-4010-b082-f412d0972e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:48.772229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:48.772858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.773159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.773426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] PATH_INFO: `/v3/groups` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.774062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:48.775499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:48.797031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 159/323] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 10 10:57:48 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:57:48.805891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:48.825853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 165/324] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:48.847886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:48.904298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ce53-5bf2-4542-b2cc-dbc621e7c0c1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.904477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ce53-5bf2-4542-b2cc-dbc621e7c0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.904717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ce53-5bf2-4542-b2cc-dbc621e7c0c1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.906271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 166/325] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:48.911727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:48.912028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:48.912279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:48.916916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:48.932601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:48.933840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:48.966441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd60a5-cb67-49e8-b4de-2fcf2edcfe2c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.010935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.011580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.011850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.012115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.014266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 167/326] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:49.024996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:49.030979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:49.031827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:49.032615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 160/327] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:49.038277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.039095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.172415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967eeb-74f2-4a28-a14a-01e197b1d159 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.181322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7c20-4a5e-4378-91f8-b3cea83f107a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.190777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:49.214295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:49.216295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.216951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.217411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.217687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.224216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.224839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.225141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.225769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.226498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:49.227761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:49.229225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:49.230760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:49.236123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:49.237051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:49.237848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:49.238900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 168/328] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:49.244024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.246385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 161/329] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:49.252379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.365659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113b29d-c891-4b42-ae28-0ee667fadf4b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.391118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc90cc6-3247-4ac6-82d5-f55eda966de7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.406741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.407347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.407615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.407881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.408536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:49.408826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:49.410328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:49.419615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 169/330] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:49.424959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.431045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.431688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.431955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.432212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] PATH_INFO: `/v3/users/708b8ef6701d4be59140f13470f5e888` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.433475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] RBAC: Authorizing `identity:get_user(user_id=708b8ef6701d4be59140f13470f5e888)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:49.434953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:49.436856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 162/331] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:49 2022] GET /identity/v3/users/708b8ef6701d4be59140f13470f5e888 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:49.445962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.472395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:49.501549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:49.537135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626530cd-932b-4639-ba47-61ea043508bd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.552429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee02c3-0e96-40f7-a708-7ea5f1517dee None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.573768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.574399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.574667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.574925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] PATH_INFO: `/v3/users/12c51f86aef345a9bb48c75d2c557ee0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.576734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] RBAC: Authorizing `identity:get_user(user_id=12c51f86aef345a9bb48c75d2c557ee0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:49.578218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:49.580154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 170/332] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:49 2022] GET /identity/v3/users/12c51f86aef345a9bb48c75d2c557ee0 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:49.585746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:49.604779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ced645-6b6d-4351-8085-12beda36046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.605473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced645-6b6d-4351-8085-12beda36046f None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.605749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced645-6b6d-4351-8085-12beda36046f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.606018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced645-6b6d-4351-8085-12beda36046f None admin] PATH_INFO: `/v3/system/users/708b8ef6701d4be59140f13470f5e888/roles/4cedf324d1e44684bad58ada65aff942` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.608607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ced645-6b6d-4351-8085-12beda36046f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=708b8ef6701d4be59140f13470f5e888, role_id=4cedf324d1e44684bad58ada65aff942)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:49.610048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ced645-6b6d-4351-8085-12beda36046f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:49.622863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 163/333] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 10 10:57:49 2022] PUT /identity/v3/system/users/708b8ef6701d4be59140f13470f5e888/roles/4cedf324d1e44684bad58ada65aff942 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:49.709721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb008-8a5d-4d74-83f2-0f10c7d81b4c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:49.719415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:49.751833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:49.752507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:49.752781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:49.753063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:49.753796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] RBAC: Adding query filter params (role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, user.id=12c51f86aef345a9bb48c75d2c557ee0, scope.system=all) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:49.754101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:49.755962 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29843-da3a-4def-9592-6855e646d1f2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:49.770025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 171/334] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 10 10:57:49 2022] GET /identity/v3/role_assignments?user.id=12c51f86aef345a9bb48c75d2c557ee0&scope.system=all&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:51.305987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f354cd-19db-4512-84b2-f05a4acc6031 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:51.306988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f354cd-19db-4512-84b2-f05a4acc6031 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:51.307459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f354cd-19db-4512-84b2-f05a4acc6031 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:51.309269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 164/335] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:51.316233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:51.316760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:51.316760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:51.344876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:51.346103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:51.429384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 172/336] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:51.475324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f354cd-19db-4512-84b2-f05a4acc6031 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:51.589824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f354cd-19db-4512-84b2-f05a4acc6031 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:51.609867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:51.630798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:51.631445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:51.631717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:51.631980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:51.642843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:51.651776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:51.652668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:51.653482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 165/337] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:51.660892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:51.774196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:51.784337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4a1a-6f23-4d10-9cc2-d5a9ebb14431 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:51.824504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:51.825221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:51.825511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:51.825786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:51.826454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:51.826759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:51.828159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f290a9a-6d83-4ef2-83b5-70973805130d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:51.845483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 173/338] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:51.851240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:51.972726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175675-165e-4e44-9101-c50c0370dbf6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:52.018814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc187cf-b5b2-4498-89d8-03c6c06405e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:52.019876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc187cf-b5b2-4498-89d8-03c6c06405e9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.020350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc187cf-b5b2-4498-89d8-03c6c06405e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.020809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc187cf-b5b2-4498-89d8-03c6c06405e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.079815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:52.105899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc187cf-b5b2-4498-89d8-03c6c06405e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:52.107731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc187cf-b5b2-4498-89d8-03c6c06405e9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:52.189530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2851-ef0c-4fba-8c68-429d20d75c4d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.189842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2851-ef0c-4fba-8c68-429d20d75c4d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.190071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2851-ef0c-4fba-8c68-429d20d75c4d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.191648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 174/339] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:52.196663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0023-60d2-4e11-8b44-51f5a2dc440b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.196936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0023-60d2-4e11-8b44-51f5a2dc440b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.197228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0023-60d2-4e11-8b44-51f5a2dc440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.218062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-08ae0023-60d2-4e11-8b44-51f5a2dc440b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:52.219228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-08ae0023-60d2-4e11-8b44-51f5a2dc440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:52.246488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 166/340] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:52.247816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27e797-42d4-4c2c-842f-a54eb7dd5fce None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.248045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27e797-42d4-4c2c-842f-a54eb7dd5fce None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.248307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27e797-42d4-4c2c-842f-a54eb7dd5fce None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.249550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 167/341] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:52.253066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27e797-42d4-4c2c-842f-a54eb7dd5fce None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.324834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 175/342] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:57:52.326186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.326446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.326709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.364733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:52.365846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:52.408828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:52.438962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27e797-42d4-4c2c-842f-a54eb7dd5fce None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:52.479280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 176/343] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:52.480187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.489551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd76f-f1af-45d3-a72d-62d088830075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:52.490205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd76f-f1af-45d3-a72d-62d088830075 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.490480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd76f-f1af-45d3-a72d-62d088830075 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.491262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd76f-f1af-45d3-a72d-62d088830075 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.493467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd76f-f1af-45d3-a72d-62d088830075 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:52.495440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd76f-f1af-45d3-a72d-62d088830075 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:52.498210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 168/344] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:52.498807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:52.501076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476d0a-91ac-497f-af6b-416f9706cdea None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.501528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476d0a-91ac-497f-af6b-416f9706cdea None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.505719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476d0a-91ac-497f-af6b-416f9706cdea None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.508099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 169/345] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:52.508847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476d0a-91ac-497f-af6b-416f9706cdea None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.605105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a6f3-f11f-499b-b3cf-621a20fa4bf0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:52.637961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476d0a-91ac-497f-af6b-416f9706cdea None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:52.640634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371308b-c78a-47d6-a127-5c86ab8e7d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:52.641690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371308b-c78a-47d6-a127-5c86ab8e7d8b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.641690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371308b-c78a-47d6-a127-5c86ab8e7d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.641855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371308b-c78a-47d6-a127-5c86ab8e7d8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.653162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371308b-c78a-47d6-a127-5c86ab8e7d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b371308b-c78a-47d6-a127-5c86ab8e7d8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:52.658898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:52.659809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:52.660621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 177/346] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:52.664377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.664377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.664377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.683260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:52.684435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:52.685268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:52.686124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.686628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.687093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.693853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:52.695743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:52.697718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 170/347] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:52.698853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.713377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:52.760126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 178/348] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:52.760667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.769342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:52.835850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb363e-0f62-469e-8c75-63982990137a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:52.864176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2ff2f-4ced-404f-a017-01bb9f123680 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:52.877789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:52.878748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.879341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.880164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.894062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:52.901814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:52.902235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:52.903188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:52.903993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:52.904589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:52.904589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:52.904589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:52.904589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:52.904589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:52.905381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:52.906933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:52.908375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.915190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:52.916033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:52.988242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.004804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.031521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6636923-d1d4-4737-84df-7f6c5b93b924 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.054740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671a7f4-6ad1-4b83-82ce-b594aa4c65e4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.078839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.079463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.079738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.080005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.081780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:53.081780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:53.082608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:53.090300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 172/351] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:53.091217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.105088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.106301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.106605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.106941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.133990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:53.136556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:53.137473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:53.138278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:53.138889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 180/352] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:53.139434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.236104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e183357-8f43-43a7-9e73-4003fec59e83 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.264652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445fdcf-0b30-46aa-a119-a75598f875b3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.278245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.288104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.289050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.289541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.289955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.290766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:53.291233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:53.293664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29ab6-a5a6-4a63-aca1-f5a0a7831cfe None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:53.301055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.307672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 173/353] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:53.309294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b33be-40a1-4449-bfb8-3e5ea87d7464 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.309829 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b33be-40a1-4449-bfb8-3e5ea87d7464 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.310242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b33be-40a1-4449-bfb8-3e5ea87d7464 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.310662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.311303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.316001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.316001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] PATH_INFO: `/v3/users/708b8ef6701d4be59140f13470f5e888` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.316001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] RBAC: Authorizing `identity:get_user(user_id=708b8ef6701d4be59140f13470f5e888)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:53.316001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:53.317480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 174/354] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:53.318070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 181/355] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/users/708b8ef6701d4be59140f13470f5e888 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:53.318627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b33be-40a1-4449-bfb8-3e5ea87d7464 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.318860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.451686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3d09-7cb3-4feb-b2d1-059e4cc328f1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.454758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b33be-40a1-4449-bfb8-3e5ea87d7464 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.496795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.497370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.497573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.497682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.497941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.498674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.499145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.499592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.500432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:53.501101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:53.503534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792f9a-0cc8-4220-90be-0f84792e3264 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:53.514625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 175/356] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:53.516204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.516634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.517071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.539944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:53.542147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:53.588660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.591000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:53.594455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:53.616567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.642733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 176/357] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:53.643620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.721989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 182/358] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:53.722303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.783122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ac3d-70a6-4185-9f3d-59cba3ff5a6f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.826962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.827603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.827875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.828141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.828844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] RBAC: Adding query filter params (role.id=4cedf324d1e44684bad58ada65aff942, user.id=708b8ef6701d4be59140f13470f5e888, scope.system=all) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:53.829170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:53.830613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613588d-a4e2-4495-911a-e3865a9b7609 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:53.842812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.843335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 177/359] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/role_assignments?user.id=708b8ef6701d4be59140f13470f5e888&scope.system=all&role.id=4cedf324d1e44684bad58ada65aff942 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:53.844480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996e77d-00a7-4f5b-858d-dac19d2dd0ad None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.844678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996e77d-00a7-4f5b-858d-dac19d2dd0ad None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.844918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996e77d-00a7-4f5b-858d-dac19d2dd0ad None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.847519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 178/360] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:53.848303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996e77d-00a7-4f5b-858d-dac19d2dd0ad None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:53.858075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b333a93-202a-4ce9-b961-02ab3c891fac None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.908057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:53.910806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722be90-79b0-43f4-b01c-5d9a6ffad7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:53.911791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722be90-79b0-43f4-b01c-5d9a6ffad7ca None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:53.912072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722be90-79b0-43f4-b01c-5d9a6ffad7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:53.912334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722be90-79b0-43f4-b01c-5d9a6ffad7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:53.988949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996e77d-00a7-4f5b-858d-dac19d2dd0ad None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:53.998891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722be90-79b0-43f4-b01c-5d9a6ffad7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.000537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722be90-79b0-43f4-b01c-5d9a6ffad7ca None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.037996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.038690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.039158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.039382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.050518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:54.055758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:54.056651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:54.057517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 179/361] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:54.058204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.130940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.137741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 183/362] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:54.139013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093854c-0cec-445a-8622-79135206834f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.139636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093854c-0cec-445a-8622-79135206834f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.139997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093854c-0cec-445a-8622-79135206834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.158389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2093854c-0cec-445a-8622-79135206834f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:54.159694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2093854c-0cec-445a-8622-79135206834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:54.175450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fca15-c9da-4847-b2f5-dbc2063cb058 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.178173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.218244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.218877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.219146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.219406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.220548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.222019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.223835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 180/363] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:54.224907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.244318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 184/364] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:54.245315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093854c-0cec-445a-8622-79135206834f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.340143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2c557-afe6-4f61-9ae0-7bae96c96db5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.374490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093854c-0cec-445a-8622-79135206834f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.382713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.383275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.383553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.383818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.384624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:54.384913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.386863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.398407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 181/365] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:54.400306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.407521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.418161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.419145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.419421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.420205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.420803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.422355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.424161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 185/366] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:54.424772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.443117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.525471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f0f15-3885-4bcf-ac4f-b73a308fccbf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.558752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa473c-f10d-4f90-a98e-6527e0c59a68 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.564041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.564681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.564956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.565261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.566383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.567861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.570100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 182/367] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:54.570297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.606770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.607334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.607609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.607878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.620949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:54.625867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:54.626785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:54.627601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:54.628801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 186/368] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:54.629450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.687637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e723ee-78d1-4fc6-aa0c-6af69aab594f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.689238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.690823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.730896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.731509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.731779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.732039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.746748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a467-d9aa-40a0-8203-f679973df3fa None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.789889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.790560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.790833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.791101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.792270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.793783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.795551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 187/369] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:54.796195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.828433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.832199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.924373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf90d82-f481-4ce5-922c-fc998a70ad08 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:54.950378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.965307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:54.966064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:54.966444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:54.966805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:54.967632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=137d83a6d55341aab18d66327415150f, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:54.968065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:54.969615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:54.975264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 183/370] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:54.976556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:54.979114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:54.981060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 188/371] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=137d83a6d55341aab18d66327415150f => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:54.982155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.093343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f06aa-9887-4c0f-9d93-f0592e2df9b2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.112722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76de84-42ef-4d04-9aba-7dde05be5996 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.137762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.138781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.139277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.139757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.140632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:55.141162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.142773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.153264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 184/372] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:55.154281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.165563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.166195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.166469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.166730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.167464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=93886058307e40e88cba52acb7c07fde) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:55.167765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.169375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.176495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 189/373] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:57:54 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:55.177963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.253271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:55.256901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:55.332253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4621953-82e6-4fdc-b1b5-b7e80edd6a93 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.360003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075232e-9a7e-4466-b643-3491c818c2a2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.383105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6071a-16e4-4d96-9ec5-ceb313255aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.383758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6071a-16e4-4d96-9ec5-ceb313255aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.384035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6071a-16e4-4d96-9ec5-ceb313255aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.384302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6071a-16e4-4d96-9ec5-ceb313255aa9 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.385528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6071a-16e4-4d96-9ec5-ceb313255aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.386991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6071a-16e4-4d96-9ec5-ceb313255aa9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.389101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 185/374] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:55.390325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86996-31b1-403f-9571-fc898260c36a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.390601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86996-31b1-403f-9571-fc898260c36a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.390868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86996-31b1-403f-9571-fc898260c36a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.392330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 186/375] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:55.398369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef86996-31b1-403f-9571-fc898260c36a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.413501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.414123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.414394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.414659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.506188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.508156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.531055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef86996-31b1-403f-9571-fc898260c36a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.569380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:55.587737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:55.597606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2e4a6-46b4-4469-88f3-7d376e46626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.598512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e4a6-46b4-4469-88f3-7d376e46626a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.598829 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e4a6-46b4-4469-88f3-7d376e46626a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.599095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e4a6-46b4-4469-88f3-7d376e46626a None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.602253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2e4a6-46b4-4469-88f3-7d376e46626a None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.603758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2e4a6-46b4-4469-88f3-7d376e46626a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.605758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 187/376] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:55.607923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.608196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.608461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.632713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:55.634343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:55.644055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 190/377] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:57:55.645168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.723907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 188/378] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:55.725702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.759592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe448bd-7baf-4987-abe0-ad87f5c0c5a7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.801124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.801742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.802009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.802272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.802990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=137d83a6d55341aab18d66327415150f, scope.project.id=93886058307e40e88cba52acb7c07fde) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:55.803745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.805652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.814187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 191/379] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=137d83a6d55341aab18d66327415150f => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:55.815342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.836487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:55.871769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734670e9-41de-4d53-8736-b53d1c8fbcbd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.904104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:55.912173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.912852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.913171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.913498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] PATH_INFO: `/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:55.914671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] RBAC: Authorizing `identity:get_project(project_id=65fdb45b0c1547cc9b08e89b6225a55f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:55.916151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:55.921419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 189/380] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:55.924020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:55.948061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3231bf-cb9b-40eb-8de9-888a8d593198 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:55.992548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:55.993514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:55.996514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:55.996514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.012797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:56.018233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:56.019202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:56.020022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 192/381] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:56.026301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:56.064045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067ea9d-33ac-47f1-812c-c36d7c28443c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:56.129988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:56.130998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:56.132169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:56.132440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] PATH_INFO: `/v3/groups/49fc1bcd824044fd96a4db6c0fd94cad` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.139104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] RBAC: Authorizing `identity:get_group(group_id=49fc1bcd824044fd96a4db6c0fd94cad)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:56.140663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:56.147319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 190/382] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:55 2022] GET /identity/v3/groups/49fc1bcd824044fd96a4db6c0fd94cad => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:56.149022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:56.154561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:56.185907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028bc83-b472-4393-8278-09d041bea0e0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:56.230929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:56.232061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:56.232540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:56.233029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.233893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:56.234377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:56.234755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:56.236152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:56.246002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 193/383] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:56.253280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:56.287647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ec97-63cd-4afa-8f38-14bc99bf8c4c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:56.383413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:56.384048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:56.384317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:56.384581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.385216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e67b71-75de-427e-959b-ff1f1f900c9e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:56.385331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] RBAC: Adding query filter params (group.id=49fc1bcd824044fd96a4db6c0fd94cad, role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=65fdb45b0c1547cc9b08e89b6225a55f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:56.385626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:56.387068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:56.403278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 191/384] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:57:56 2022] GET /identity/v3/role_assignments?group.id=49fc1bcd824044fd96a4db6c0fd94cad&scope.project.id=65fdb45b0c1547cc9b08e89b6225a55f&role.id=b6a5fb3a069640758072d30fba5d307c => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:56.429275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:56.429964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:56.433623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:56.433623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.433623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:56.433623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:56.435312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 194/385] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:56 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:56.442161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:56.586485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda9be9-7d6c-4508-bf7e-3f59d1fa39ed None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:56.615490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:56.625481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5399a1-8a42-4c82-bfcf-fc47e050a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:56.626184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5399a1-8a42-4c82-bfcf-fc47e050a604 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:56.626457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5399a1-8a42-4c82-bfcf-fc47e050a604 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:56.626721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5399a1-8a42-4c82-bfcf-fc47e050a604 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.627942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5399a1-8a42-4c82-bfcf-fc47e050a604 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:56.629481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5399a1-8a42-4c82-bfcf-fc47e050a604 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:56.631999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 192/386] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:56 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:56.638142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:56.642287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:56.754911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f069b-d35a-49f7-bb53-353c0a7e24ce None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:56.795475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4606eb-47bd-448c-afcd-3c1388ced44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:56.796468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4606eb-47bd-448c-afcd-3c1388ced44c None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:56.796913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4606eb-47bd-448c-afcd-3c1388ced44c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:56.797391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4606eb-47bd-448c-afcd-3c1388ced44c None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/groups/76bcf5bee8534d58afbf0033f72efee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:56.802255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4606eb-47bd-448c-afcd-3c1388ced44c None admin] RBAC: Authorizing `identity:create_grant(project_id=4d5aed4d3bc249fc911d4a7ded8a1799, group_id=76bcf5bee8534d58afbf0033f72efee2, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:56.804014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4606eb-47bd-448c-afcd-3c1388ced44c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:56.833664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 195/387] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 10 10:57:56 2022] PUT /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/groups/76bcf5bee8534d58afbf0033f72efee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:57.542259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3044d-cd06-4778-b766-12eca1431d7d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:57.542949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3044d-cd06-4778-b766-12eca1431d7d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:57.543454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3044d-cd06-4778-b766-12eca1431d7d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:57.545337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 193/388] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:57.550262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ea73-3bf2-449e-8afb-55fc24342609 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:57.550772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ea73-3bf2-449e-8afb-55fc24342609 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:57.551236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ea73-3bf2-449e-8afb-55fc24342609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:57.575844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c764ea73-3bf2-449e-8afb-55fc24342609 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:57.577337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c764ea73-3bf2-449e-8afb-55fc24342609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:57.645902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:57.656672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 196/389] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:57.686377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3044d-cd06-4778-b766-12eca1431d7d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:57.773037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec8f7e-aeef-44da-8ed1-a269fda072bc None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:57.773678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec8f7e-aeef-44da-8ed1-a269fda072bc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:57.774135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec8f7e-aeef-44da-8ed1-a269fda072bc None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:57.775900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 197/390] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:57.781370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:57.781823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:57.782255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:57.809454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3044d-cd06-4778-b766-12eca1431d7d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:57.825988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:57.827401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:57.845895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:57.847151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:57.847582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:57.847986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:57.859298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:57.865032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:57.866119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:57.867233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:57.869999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 194/391] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:57.875167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:57.950466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 198/392] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:57.979358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:57.985369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.052219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dcb24-c9f9-4fb5-86b7-a436ce322f50 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.089358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.090195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.090738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.091159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.091955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:58.092408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.094302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.103737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 195/393] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:58.109565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.161960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03338d-04e8-4682-9521-14d74f5f9aaf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.212029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:58.232819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.233505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.233780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.234047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.259433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:58.266151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:58.267065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:57:58.268175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 199/394] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:57:58.273190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.307354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883618a4-3467-4a32-887c-582cc36e8b37 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.324245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:58.350179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.351243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.351709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.352175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.353495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.355144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.361079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 196/395] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:58 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:58.362963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.404491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83d11-36b7-4ba1-9fd2-5e3bf278656b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.441375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.442328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.442596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.442858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.443515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:58.443908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.445458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70339c-4c07-4743-9158-10d40632e7f2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.454350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 200/396] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:58.459888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3628-febf-432f-a26b-c182b03e5068 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.460197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3628-febf-432f-a26b-c182b03e5068 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.460466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3628-febf-432f-a26b-c182b03e5068 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.461948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 201/397] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:58.462654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3628-febf-432f-a26b-c182b03e5068 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.482116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2e06-85da-4fed-aed1-d28fedb30477 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.514969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:58.534497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2b6b-6f86-4e41-be31-a09564ff8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.535986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2b6b-6f86-4e41-be31-a09564ff8694 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.536547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2b6b-6f86-4e41-be31-a09564ff8694 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.537024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2b6b-6f86-4e41-be31-a09564ff8694 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.539237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c2b6b-6f86-4e41-be31-a09564ff8694 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.541192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c2b6b-6f86-4e41-be31-a09564ff8694 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.550332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 197/398] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:58 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:58.551664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.551941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.552206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.570946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:58.572442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:58.585321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3628-febf-432f-a26b-c182b03e5068 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.626494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:58.633595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.634351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.634730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.635089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.637400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.639341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.646263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 202/399] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:58 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:58.646263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.655284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 198/400] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:58.656243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.759450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8e38-3f26-4fa3-a82a-709e1a18a0a2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.763178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984093b-9127-4202-bf36-de9abd393661 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.777807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:58.799260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.800328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.800789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.801287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.802482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.802930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.803199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.803477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.803742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/groups/76bcf5bee8534d58afbf0033f72efee2/roles/137d83a6d55341aab18d66327415150f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:58.805259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.805990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d5aed4d3bc249fc911d4a7ded8a1799, group_id=76bcf5bee8534d58afbf0033f72efee2, role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:58.807478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:58.812456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 199/401] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:58 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:58.812834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.831451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 203/402] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 10 10:57:58 2022] PUT /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799/groups/76bcf5bee8534d58afbf0033f72efee2/roles/137d83a6d55341aab18d66327415150f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:58.832514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:58.879942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:58.942572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e071d0-4417-4c73-b4ef-bea74f40785a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:58.984697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:58.985790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:58.986254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:58.986902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.010563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:59.019933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:59.020926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:57:59.021750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:59.030427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 200/403] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:57:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:59.042100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.042725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b312b56-72fc-4180-9ce1-edc645338076 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.082957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f255d-a407-4cbd-b0ab-9ba3151ac3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.084007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f255d-a407-4cbd-b0ab-9ba3151ac3a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.084450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f255d-a407-4cbd-b0ab-9ba3151ac3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.085034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f255d-a407-4cbd-b0ab-9ba3151ac3a3 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde/groups/76bcf5bee8534d58afbf0033f72efee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.087561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f255d-a407-4cbd-b0ab-9ba3151ac3a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=93886058307e40e88cba52acb7c07fde, group_id=76bcf5bee8534d58afbf0033f72efee2, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:59.089683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f255d-a407-4cbd-b0ab-9ba3151ac3a3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:59.110711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 204/404] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 10 10:57:58 2022] PUT /identity/v3/projects/93886058307e40e88cba52acb7c07fde/groups/76bcf5bee8534d58afbf0033f72efee2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:57:59.194237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662efce-a405-401a-93fb-6b7384075558 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.210594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:59.225732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2844e-3e85-47da-9854-2378fa58ec02 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.226105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2844e-3e85-47da-9854-2378fa58ec02 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.226376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2844e-3e85-47da-9854-2378fa58ec02 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.228041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 205/405] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:57:59.233251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.233618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762863-aa32-4106-89a1-67982c88bf3b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.233865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.233962 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762863-aa32-4106-89a1-67982c88bf3b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.234140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.234232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762863-aa32-4106-89a1-67982c88bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.234398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.235071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:59.235366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:59.237290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:59.247568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 201/406] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:57:59.253377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.266025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8b762863-aa32-4106-89a1-67982c88bf3b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:59.267217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8b762863-aa32-4106-89a1-67982c88bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:59.337689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:59.374709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e67bd-ccd6-4ad8-9a7b-b473ad0f2aaa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.400036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 206/407] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:59.401993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021b4c-ea85-4762-8f66-e3cb1af5eb41 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.402274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021b4c-ea85-4762-8f66-e3cb1af5eb41 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.402944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021b4c-ea85-4762-8f66-e3cb1af5eb41 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.404895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 207/408] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:57:59.410282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.410557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.410825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.423039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.423683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.423953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.424329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.425475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:59.426924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:59.428771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 202/409] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:59.429715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.431408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:57:59.432876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:57:59.473579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:59.512640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 208/410] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:57:59.513882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.544176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308a22a-81f7-46f8-94bf-747df77e3bc7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.584645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.585971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.586420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.586875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.600741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:59.607441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:59.608337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:57:59.609163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:59.612287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 203/411] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:59.613415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.639685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:59.649025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15e4df-9f31-4c87-8be1-24f986a95692 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.692642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.693402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.693775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.694141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.695609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:59.697713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:59.704999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 209/412] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:59.706023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.736877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:59.741821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797719f-064e-4128-8906-0c94b4c1a187 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.791530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.793620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.794043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.794451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.809113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:57:59.815323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364b18-b60e-45b0-bee7-1a46386eb957 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:57:59.816268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:57:59.817346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:57:59.818154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:57:59.821580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 204/413] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:57:59.822786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.858804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.859490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.859854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.860235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.861046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:57:59.861448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:59.862924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:57:59.872031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 210/414] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:57:59.872955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:57:59.906449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:57:59.940727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a350ae3-fde2-46cd-bbb8-140c90a4fe46 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:57:59.976221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:57:59.977402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:57:59.977402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:57:59.977704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde/groups/76bcf5bee8534d58afbf0033f72efee2/roles/137d83a6d55341aab18d66327415150f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:57:59.979937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=93886058307e40e88cba52acb7c07fde, group_id=76bcf5bee8534d58afbf0033f72efee2, role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:57:59.981517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.005067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 205/415] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 10 10:57:59 2022] PUT /identity/v3/projects/93886058307e40e88cba52acb7c07fde/groups/76bcf5bee8534d58afbf0033f72efee2/roles/137d83a6d55341aab18d66327415150f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:00.006643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:00.016216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cff3-a67d-4650-95a2-40a000cb783e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:00.058057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:00.093002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:00.093914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:00.094336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:00.094755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:00.095578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:00.096013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:00.098789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.117545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 211/416] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:00.121782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:00.221581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993c476-8beb-4206-a704-f400ef7475e4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:00.271519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:00.273347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:00.274114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:00.274457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:00.275024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:00.295632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094532a-2628-4379-af88-aff53f0b73f5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:00.349350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:00.349993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:00.350268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:00.350536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] PATH_INFO: `/v3/groups/49fc1bcd824044fd96a4db6c0fd94cad` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:00.352050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] RBAC: Authorizing `identity:get_group(group_id=49fc1bcd824044fd96a4db6c0fd94cad)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:00.353542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.359834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 212/417] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:58:00 2022] GET /identity/v3/groups/49fc1bcd824044fd96a4db6c0fd94cad => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:00.365565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:00.379982 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:00.384212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.429372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:00.541011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 206/418] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:00.541011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:00.557949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5167eb-381f-4f96-b49e-af6037774229 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:00.597509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:00.598212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:00.598490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:00.598755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] PATH_INFO: `/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:00.599873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] RBAC: Authorizing `identity:get_project(project_id=65fdb45b0c1547cc9b08e89b6225a55f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:00.601528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.604041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 213/419] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:58:00 2022] GET /identity/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:00.609448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:00.645526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:00.719566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293f8d-423a-4d98-8754-14660da02155 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:00.786191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:00.786858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:00.787128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:00.787393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] PATH_INFO: `/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f/groups/49fc1bcd824044fd96a4db6c0fd94cad/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:00.792119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8cd16-6939-4126-a530-f053052fc389 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:00.794641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] RBAC: Authorizing `identity:create_grant(project_id=65fdb45b0c1547cc9b08e89b6225a55f, group_id=49fc1bcd824044fd96a4db6c0fd94cad, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:00.796103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.820730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:00.828505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 214/420] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 10 10:58:00 2022] PUT /identity/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f/groups/49fc1bcd824044fd96a4db6c0fd94cad/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:00.852258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:00.852931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:00.853306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:00.853571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:00.854800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:00.856285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:00.858076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 207/421] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:58:00 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:00.864465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:00.983008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:01.009703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261343-be2a-4652-bff9-a882318ddb9a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.057090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0fad-869f-4be9-8de0-482efea9234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.058104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0fad-869f-4be9-8de0-482efea9234d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.058578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0fad-869f-4be9-8de0-482efea9234d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.059038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0fad-869f-4be9-8de0-482efea9234d None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.060351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0fad-869f-4be9-8de0-482efea9234d None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:01.062133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0fad-869f-4be9-8de0-482efea9234d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:01.064268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 215/422] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:58:00 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:01.071307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:01.206942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cf9e8-1dcc-4d9b-ae1d-13a2d79e0367 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.224220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805df32-1ba2-4628-9ea1-320f890afdd1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.224882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805df32-1ba2-4628-9ea1-320f890afdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.225383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805df32-1ba2-4628-9ea1-320f890afdd1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.227273 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 216/423] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:01.232206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8eae0-f609-46e8-9896-3778c150473d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.232433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8eae0-f609-46e8-9896-3778c150473d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.232686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8eae0-f609-46e8-9896-3778c150473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.245136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.246052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.246522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.247026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.247941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:01.248439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:01.254264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:01.256722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7cb8eae0-f609-46e8-9896-3778c150473d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:01.258127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7cb8eae0-f609-46e8-9896-3778c150473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:01.262856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 208/424] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:01.357769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 217/425] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:01.392257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:01.461286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:01.471025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f06aa-cad0-448d-a892-81ba6c2f48b0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.471342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f06aa-cad0-448d-a892-81ba6c2f48b0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.471562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f06aa-cad0-448d-a892-81ba6c2f48b0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.473938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 218/426] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:01.478150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.478532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.478857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.498460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:01.499640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:01.533189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc170c1-2e4c-4266-814c-3fae1a7db5d3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.570472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.571114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.571383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.571644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.580760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 219/427] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:58:01.589459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:01.594786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:01.595648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:58:01.596441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:01.600969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 209/428] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:01.602172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:01.611756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:01.635991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:01.716647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf41c-92f7-415e-aa3a-688d7040a130 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.717614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d863-bc85-4f27-961f-47d7e9480f10 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.732917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:01.757843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.758808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.758931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.759670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.759789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.760113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.760316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.760551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.761350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:01.761744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:01.763318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:01.771808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:01.773217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 220/429] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:01.777934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:01.778810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 10:58:01.779605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:01.782117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 210/430] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:01.783405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:01.788274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:01.872860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:01.901772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77d528-eb41-42be-bffa-a96286bd1bfc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.907106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214730c-a35e-4b75-95e5-b97bcc472ea6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:01.941159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.942134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.943250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.944058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.945946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:01.946879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:01.948266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:01.950651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:01.951487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:01.951951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:01.952403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:01.957780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 211/431] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:01.963680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.003355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.025050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.026839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.075606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0fc80-4c92-4a05-910f-bf25023f40d9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.102131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.119075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.119708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.119981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.120248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.137978 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 221/432] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:02.143853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.220747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.222234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.260163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.288281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019dc7-195e-40b6-8d40-144a2bbc3278 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.331102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 212/433] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:02.332704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.337026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.337026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.337026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] PATH_INFO: `/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.337296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.342778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] RBAC: Authorizing `identity:get_project(project_id=4d5aed4d3bc249fc911d4a7ded8a1799)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.342778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.342986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 222/434] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/projects/4d5aed4d3bc249fc911d4a7ded8a1799 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:02.350913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.401477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.452093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee827-11c8-492e-80ef-87c9e23021f4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.465532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648d70-1c2d-471e-85f5-da320394ea74 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.486784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.487765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.488236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.488693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.490048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.491813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.498971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 223/435] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:02.500077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.506315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e517bf-6b10-484f-9e96-96dc1a4a4370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.507010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e517bf-6b10-484f-9e96-96dc1a4a4370 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.507281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e517bf-6b10-484f-9e96-96dc1a4a4370 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.507548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e517bf-6b10-484f-9e96-96dc1a4a4370 None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.508684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e517bf-6b10-484f-9e96-96dc1a4a4370 None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.510164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e517bf-6b10-484f-9e96-96dc1a4a4370 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.516133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 213/436] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:02.518262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107abc20-08aa-45a6-a5da-1408799bc6fc None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.518544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107abc20-08aa-45a6-a5da-1408799bc6fc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.518812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107abc20-08aa-45a6-a5da-1408799bc6fc None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.520372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 214/437] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:02.521005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107abc20-08aa-45a6-a5da-1408799bc6fc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.524243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.608724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609de4c-c3c1-4be5-a660-abc8bdeec9ed None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.617949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.635673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107abc20-08aa-45a6-a5da-1408799bc6fc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.646429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.647038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.647311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.647652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.648656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=137d83a6d55341aab18d66327415150f, scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:02.648960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.650418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d920-b752-4c10-9f6e-804181256d8e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.661175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 224/438] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=4d5aed4d3bc249fc911d4a7ded8a1799&role.id=137d83a6d55341aab18d66327415150f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:02.661175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.661175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.661175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.681927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.682574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.682846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.683114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.684374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.686130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.686726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:02.687959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 215/439] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:02.688689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:02.694339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.775534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.799022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 225/440] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:02.816303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:02.816490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1af4ab-8b1a-47a6-b0fc-fdd19d8faf73 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.858652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.859275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.859551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.860660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:02.861512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=bfca7dcaa6ab42089f5b35de5ab9a97a, scope.project.id=93886058307e40e88cba52acb7c07fde) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:02.861851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:02.863287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:02.871563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 216/441] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=bfca7dcaa6ab42089f5b35de5ab9a97a => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:02.949849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faecd0-8d58-4323-8af4-88113b457594 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:02.951515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:02.990950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fc95-888c-4ae3-95c7-d6dedeea8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:02.991648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fc95-888c-4ae3-95c7-d6dedeea8a62 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:02.991925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fc95-888c-4ae3-95c7-d6dedeea8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:02.992191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fc95-888c-4ae3-95c7-d6dedeea8a62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.004560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5fc95-888c-4ae3-95c7-d6dedeea8a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-09e5fc95-888c-4ae3-95c7-d6dedeea8a62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:03.010025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:03.010977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:03.011774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 226/442] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:03.017653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.090359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff75d-721f-4d6f-950f-e5265033f687 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.090684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff75d-721f-4d6f-950f-e5265033f687 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.090914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff75d-721f-4d6f-950f-e5265033f687 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.092262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 227/443] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:03.097752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.098025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.098294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.125307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:03.126521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:03.139282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b8f3e-43af-4e5a-a39f-72b92893c6d9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.175848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.176461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.176734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.177023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.177718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:03.178102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.179912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.181144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.189214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 217/444] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:03.195059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.204909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 228/445] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:58:03.227683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.307686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e008d7-0f05-4489-8a64-57b017402a70 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.332868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.341760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f90b4-f9b6-4c7a-b07b-88310c56ad28 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.341971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.342622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.342897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.343164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.378773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c249183-4714-4663-9990-812a8924db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.379400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c249183-4714-4663-9990-812a8924db95 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.379668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c249183-4714-4663-9990-812a8924db95 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.379924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c249183-4714-4663-9990-812a8924db95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.390637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c249183-4714-4663-9990-812a8924db95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-5c249183-4714-4663-9990-812a8924db95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:03.395417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:03.396410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:03.397237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 229/446] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:03.402631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c249183-4714-4663-9990-812a8924db95 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.405575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.412531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.414050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.502341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c249183-4714-4663-9990-812a8924db95 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.510062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 218/447] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 10:58:03.515728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.535394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.536231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.536502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.536765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.537457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:03.537751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.539153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.546917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 230/448] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:03.552501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.567779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.609158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.615732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89afb2-739d-4c35-a85a-ffe3372cc850 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.648628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.649285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.649558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.649825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] PATH_INFO: `/v3/projects/93886058307e40e88cba52acb7c07fde` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.650968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] RBAC: Authorizing `identity:get_project(project_id=93886058307e40e88cba52acb7c07fde)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.652200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0b13-9a41-4801-bd79-7bded11916d2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.652410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.654061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 219/449] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/projects/93886058307e40e88cba52acb7c07fde => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:03.659736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.692476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.693113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.693384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.693649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.764372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f505f4-fb7e-4cb9-be9c-2cca2c1cbd9a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.766897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.768369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.782619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.798060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.798682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.798953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.799216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] PATH_INFO: `/v3/groups/76bcf5bee8534d58afbf0033f72efee2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.800324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] RBAC: Authorizing `identity:get_group(group_id=76bcf5bee8534d58afbf0033f72efee2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.801863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.803425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 220/450] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/groups/76bcf5bee8534d58afbf0033f72efee2 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:03.809224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.838845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:03.864555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 231/451] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 10:58:03.870327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:03.908919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2165f-0298-427e-8267-9595f32a188d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.941750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:03.942309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:03.942593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:03.942860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:03.943581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] RBAC: Adding query filter params (group.id=76bcf5bee8534d58afbf0033f72efee2, role.id=137d83a6d55341aab18d66327415150f, scope.project.id=93886058307e40e88cba52acb7c07fde) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:03.943918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:03.945445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:03.951213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 221/452] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/role_assignments?group.id=76bcf5bee8534d58afbf0033f72efee2&scope.project.id=93886058307e40e88cba52acb7c07fde&role.id=137d83a6d55341aab18d66327415150f => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:03.974893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3b98-f0ec-4c5e-ae9a-2ec284db72c1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:03.992195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:04.019089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:04.019648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:04.019918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:04.020182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] PATH_INFO: `/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:04.021424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] RBAC: Authorizing `identity:get_project(project_id=65fdb45b0c1547cc9b08e89b6225a55f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:04.023049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:04.024965 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 232/453] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:58:03 2022] GET /identity/v3/projects/65fdb45b0c1547cc9b08e89b6225a55f => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:04.031061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:04.135203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:04.142302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c39077-a06a-472a-898a-ff2f13ba7f7c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:04.177732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3078f-560e-41ee-8e9a-4fe8b407a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:04.178372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3078f-560e-41ee-8e9a-4fe8b407a670 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:04.178630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3078f-560e-41ee-8e9a-4fe8b407a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:04.178991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3078f-560e-41ee-8e9a-4fe8b407a670 None admin] PATH_INFO: `/v3/groups/49fc1bcd824044fd96a4db6c0fd94cad` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:04.180110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3078f-560e-41ee-8e9a-4fe8b407a670 None admin] RBAC: Authorizing `identity:get_group(group_id=49fc1bcd824044fd96a4db6c0fd94cad)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:04.181617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3078f-560e-41ee-8e9a-4fe8b407a670 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:04.183349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 222/454] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 10 10:58:04 2022] GET /identity/v3/groups/49fc1bcd824044fd96a4db6c0fd94cad => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:04.189423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:04.287837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8a56d-347a-453f-a319-a8d0e16510dc None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:04.321074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:04.321653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:04.321930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:04.322196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:04.322905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] RBAC: Adding query filter params (group.id=49fc1bcd824044fd96a4db6c0fd94cad, role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=65fdb45b0c1547cc9b08e89b6225a55f) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:04.323202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:04.324648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a251d6-9247-4f10-864d-e1388bca692f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:04.330878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 233/455] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 10 10:58:04 2022] GET /identity/v3/role_assignments?group.id=49fc1bcd824044fd96a4db6c0fd94cad&scope.project.id=65fdb45b0c1547cc9b08e89b6225a55f&role.id=b6a5fb3a069640758072d30fba5d307c => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:06.658792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e03cc-eed1-44be-bc82-0e316b3935ba None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:06.659317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e03cc-eed1-44be-bc82-0e316b3935ba None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:06.659317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e03cc-eed1-44be-bc82-0e316b3935ba None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:06.660935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 223/456] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:06.665959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cbade-f15f-434c-b9ff-42f68841a54d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:06.666691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cbade-f15f-434c-b9ff-42f68841a54d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:06.667094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cbade-f15f-434c-b9ff-42f68841a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:06.693958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f63cbade-f15f-434c-b9ff-42f68841a54d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:06.695518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f63cbade-f15f-434c-b9ff-42f68841a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:06.751479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:06.783569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 234/457] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:06.830551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e03cc-eed1-44be-bc82-0e316b3935ba None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:06.971005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e03cc-eed1-44be-bc82-0e316b3935ba None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.010311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb921e-f3a4-44b1-8e4a-940cdc389ca7 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.010827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb921e-f3a4-44b1-8e4a-940cdc389ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.011242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb921e-f3a4-44b1-8e4a-940cdc389ca7 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.012950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 235/458] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:07.018440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d3760-9f7b-4f67-890f-8029b1448b26 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.018896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d3760-9f7b-4f67-890f-8029b1448b26 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.019423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d3760-9f7b-4f67-890f-8029b1448b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.019807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.020422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.020695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.020958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.040490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.041984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.047361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-052d3760-9f7b-4f67-890f-8029b1448b26 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:07.049269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-052d3760-9f7b-4f67-890f-8029b1448b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-8078c345-08d5-4d05-9416-a4875df5e221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:07.056469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:07.057413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:07.058296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:07.058296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:07.058296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:07.058296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 224/459] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:07.059103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abf47-146c-4108-9019-10df94e4d531 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.059381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abf47-146c-4108-9019-10df94e4d531 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.059646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abf47-146c-4108-9019-10df94e4d531 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.061103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 225/460] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:07.065716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abf47-146c-4108-9019-10df94e4d531 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.084526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:07.149053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 236/461] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:58:07.150622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.151031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.151614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.176829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:07.178200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:07.202020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abf47-146c-4108-9019-10df94e4d531 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.243725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.244252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.244524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.244787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.245482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:07.245773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.247599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.262612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 237/463] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:07.263931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.266637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 226/463] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:07.268832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.329372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:07.359525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:07.384340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4478f-d07b-4695-9ec8-fb5392fc651c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.384903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c44f7-fa83-4c86-911f-5c201fb004dd None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.419298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.419767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.420402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.420676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.420889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.421003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.421530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.422024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.422842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.424448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.431872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.433475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.449987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 227/464] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:58:07 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:58:07.451154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:07.458902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:07.459869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:07.460873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:07.460873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:07.460873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:07.460873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 238/465] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:07.466332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.565867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:07.578034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820a46-acd3-4d9d-b5a6-4d6ac2b3c5bb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.579140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52029ac1-0742-4bff-b937-24331c3da45a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.614384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:07.618699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5666-141d-4451-bbad-584181781369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.619314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5666-141d-4451-bbad-584181781369 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.619585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5666-141d-4451-bbad-584181781369 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.619848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5666-141d-4451-bbad-584181781369 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.620504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5666-141d-4451-bbad-584181781369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:07.620846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5666-141d-4451-bbad-584181781369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.622306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5666-141d-4451-bbad-584181781369 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.623586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.624526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.625156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.625623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.635870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 239/466] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:07.638210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb001814-7d12-4048-a4ce-218a6c3bd73b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.638499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb001814-7d12-4048-a4ce-218a6c3bd73b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.638764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb001814-7d12-4048-a4ce-218a6c3bd73b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.639382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.640389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 240/467] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:07.641086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb001814-7d12-4048-a4ce-218a6c3bd73b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.641863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ccfbf005-a529-430f-9fd3-f2fe994f90d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:07.657537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:07.658499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:07.659798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:07.659798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:07.659798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:07.661632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 228/468] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:07.663164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.663319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.663742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.686023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:07.687223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:07.759546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb001814-7d12-4048-a4ce-218a6c3bd73b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.766110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 229/469] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:07.767043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.816623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:07.817171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:07.817803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:07.817803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:07.818421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:07.819898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:07.846725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 241/470] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:58:07 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:58:07.853123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:07.860662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:07.912446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e24ac-29f9-41dd-b689-dc8e312abf39 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:07.962605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:08.008020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354a46-22cb-4324-86af-e6031fbfae4e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:08.030743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.032063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.032571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.033212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.034043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:08.034532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:08.036170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:08.049213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.049859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.050133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.050398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.053100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 230/471] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:08.062337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:08.062503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:08.063799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:08.082319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:08.083386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:08.084419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:08.084419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:08.084419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:08.084419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 242/472] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:08.089959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:08.161379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:08.185820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25e21-03a1-455f-b800-587a56516311 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:08.219661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc478ed-03d8-44dd-9305-4938eb360bb0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:08.235343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.236076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.236349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.236610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.237524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:08.239666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:08.263152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.264070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.264459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.264856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.265732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:08.266125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:08.267668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b998e0-dd15-4b04-89df-4cf94243fec4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:08.268781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 231/473] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:58:08 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:08.292694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 243/474] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:08.298202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:08.309587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d8e9-415b-4e66-9cab-bcaa5693a997 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.310221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d8e9-415b-4e66-9cab-bcaa5693a997 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.310692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d8e9-415b-4e66-9cab-bcaa5693a997 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.312683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 244/475] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:08.318979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.319676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.320135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.339873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:08.341842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:08.358247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:08.473422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770e986-c468-43a6-addd-351bb963f5ed None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:08.486833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 245/476] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:58:08.508637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:08.521478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.522094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.522368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.522709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.523401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:08.524844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:08.551563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 232/477] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:58:08 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:08.574607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:08.643537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47433e0e-1a97-4cf3-9a91-87dcb2547ca1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:08.686640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.687271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.687544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.687808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.688498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:08.689938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:08.702803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.sql.core [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 10:58:08.702803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 10:58:08.702803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [parameters: {'id': '7105d49ae3a24472b5d42a570a645dbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 10:58:08.702803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Aug 10 10:58:08.718823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 10:58:08.719819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application yield resource Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise self.value Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application session.commit() Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 10:58:08.720701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.flush() Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application compat.raise_( Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 10:58:08.721612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 10:58:08.722490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 10:58:08.723292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [parameters: {'id': '7105d49ae3a24472b5d42a570a645dbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:08.724073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 10:58:08.724864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:08.730512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 246/478] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 10 10:58:08 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:08.730660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:08.833087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:08.849238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f620-d756-4e7f-8f38-373a6bd80015 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:08.884531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac8f7f-a0c1-4e95-8c9c-3ee74de53bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:08.885268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac8f7f-a0c1-4e95-8c9c-3ee74de53bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:08.885541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac8f7f-a0c1-4e95-8c9c-3ee74de53bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:08.885803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac8f7f-a0c1-4e95-8c9c-3ee74de53bd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:08.897214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac8f7f-a0c1-4e95-8c9c-3ee74de53bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9aac8f7f-a0c1-4e95-8c9c-3ee74de53bd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:08.903079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:08.903954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 10:58:08.904739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:08.907992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 233/479] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:08.910883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:09.028157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dfa24-2290-4ab3-8dfd-b4ed2f564b3e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:09.039087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:09.064599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347edb-9817-4193-9c59-35498027216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:09.065251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347edb-9817-4193-9c59-35498027216c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:09.065519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347edb-9817-4193-9c59-35498027216c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:09.065781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347edb-9817-4193-9c59-35498027216c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:09.066444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347edb-9817-4193-9c59-35498027216c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:09.066735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347edb-9817-4193-9c59-35498027216c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:09.068106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347edb-9817-4193-9c59-35498027216c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:09.077097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 247/480] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:09.762147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb7c3c-9e09-4f09-89fc-3bae958480d5 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:09.763147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb7c3c-9e09-4f09-89fc-3bae958480d5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:09.763612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb7c3c-9e09-4f09-89fc-3bae958480d5 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:09.765448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 234/481] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:09.770765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:09.771262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:09.771715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:09.791129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:09.792624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:09.875179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 248/482] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:09.911479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb7c3c-9e09-4f09-89fc-3bae958480d5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:10.045364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb7c3c-9e09-4f09-89fc-3bae958480d5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:10.092449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:10.093103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.093380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.093647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.105997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:10.111129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:10.111986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:10.112846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 235/483] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:10.120137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:10.278219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7770b0-583c-4b5f-99ed-494ca7797f05 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:10.279882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:10.313163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:10.313680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.313952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.314214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.314873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:10.315208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:10.316595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:10.325238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 249/484] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:10.330430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:10.340329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:10.473939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168810cb-0164-4bd2-b3d0-3a51201e1f39 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:10.512419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:10.513085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.513361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.513627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.524885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:10.526367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e36abccb-c4db-4903-994b-f76e8fbde04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:10.547178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:10.548080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:10.548916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:10.548916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:10.548916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:10.548916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 236/485] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:10.555531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:10.619304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba27d9-d8de-4452-baf1-c61ac37d4cda None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.619490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba27d9-d8de-4452-baf1-c61ac37d4cda None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.619749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba27d9-d8de-4452-baf1-c61ac37d4cda None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.621532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 237/486] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:10.627942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b52d1-58d3-4bba-aebf-6dca78ab5dfd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.628217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b52d1-58d3-4bba-aebf-6dca78ab5dfd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.628489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b52d1-58d3-4bba-aebf-6dca78ab5dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.654042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-644b52d1-58d3-4bba-aebf-6dca78ab5dfd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:10.655233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-644b52d1-58d3-4bba-aebf-6dca78ab5dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:10.737961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5c87-f454-4c34-b79d-6a833377448c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:10.773888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:10.805652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:10.806608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.807068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.807517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.808343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:10.809568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:10.811146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:10.816359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 238/487] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:10.817969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b575-89f5-4ab5-ab0e-8649a9de194c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.818439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b575-89f5-4ab5-ab0e-8649a9de194c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.818947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b575-89f5-4ab5-ab0e-8649a9de194c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.820599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 239/488] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:10.826186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:10.826705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:10.827156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:10.828822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 250/489] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:10.834221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:10.851401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:10.852956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:10.864379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:10.925072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 240/490] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:58:10.931811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:10.959472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af7b0a-58fb-4319-8620-1bfec0dbb4e3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:10.999579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218de-4a41-4cad-a290-840c19949850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.000698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218de-4a41-4cad-a290-840c19949850 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.001221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218de-4a41-4cad-a290-840c19949850 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.001709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218de-4a41-4cad-a290-840c19949850 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.009952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218de-4a41-4cad-a290-840c19949850 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.011800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218de-4a41-4cad-a290-840c19949850 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-323218de-4a41-4cad-a290-840c19949850 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:11.025802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:11.026719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:11.027628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:11.030098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 251/491] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:58:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:11.031236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218de-4a41-4cad-a290-840c19949850 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.064165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52139b2e-b27e-4b80-831a-0b4da08beaec None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.085552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.110694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.113205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.113205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.113205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.126684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:11.131843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:11.132926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 241/492] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:11.138624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.151234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.171277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218de-4a41-4cad-a290-840c19949850 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.206211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda4854-a5fe-45fd-a14c-cced5cabc52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.206780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4854-a5fe-45fd-a14c-cced5cabc52c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.207046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4854-a5fe-45fd-a14c-cced5cabc52c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.207307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4854-a5fe-45fd-a14c-cced5cabc52c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.217883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda4854-a5fe-45fd-a14c-cced5cabc52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-bcda4854-a5fe-45fd-a14c-cced5cabc52c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:11.223110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:11.224233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 252/493] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:11.230289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aef47-1b9d-4a95-b77a-3a35257b29bb None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.231003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aef47-1b9d-4a95-b77a-3a35257b29bb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.231003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aef47-1b9d-4a95-b77a-3a35257b29bb None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.231003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 253/494] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:11.231003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aef47-1b9d-4a95-b77a-3a35257b29bb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.245032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2b87-226f-47e5-8a74-d0e73a7bb251 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.280232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.280928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.281294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.281632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.282360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:11.282689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.284150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.325052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 242/495] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:11.325052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.349904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aef47-1b9d-4a95-b77a-3a35257b29bb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.357143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.402352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.403203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.403641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.404041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.404895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:11.405348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.407140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48926db-9e59-48af-825f-eca4ceab488d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.417613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 254/496] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:11.419071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.419494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.419942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.433905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.435287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249801c-f2e2-44d2-9914-0dbee101f765 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.439808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:11.441007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:11.470378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.471223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.471499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.471766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.472428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:11.472727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.474134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.482151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 243/497] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:11.482951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.513483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 255/498] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:11.514587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.593240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.597734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8e20b-d973-4cb5-9ed5-0cdb34a8bc18 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.633516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99267a2c-6dc2-451d-94d8-aa89d476f19c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.634447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.635118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.635462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.635787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.669218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.669842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.670107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.670363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.673441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.682570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.684052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:11.699300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:11.700227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:11.701130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:11.701130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:11.701130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:11.701130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 256/499] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:11.701905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.710738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.712242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.807027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d16507-c4c8-4095-b2e7-4fdf465e5693 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.810186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.815071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 244/500] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:11.816425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.840446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.841104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.841408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.841677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.852070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:11.853579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:11.867279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:11.868311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:11.869191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:11.869191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:11.869191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:11.869191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 257/501] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:11.869460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:11.909885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:11.922116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fe242-0339-48c8-b4ba-29e4ea35e8af None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.954835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97809a73-5395-4288-ba88-11726b7ec69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:11.955455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97809a73-5395-4288-ba88-11726b7ec69f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.955720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97809a73-5395-4288-ba88-11726b7ec69f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.955979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97809a73-5395-4288-ba88-11726b7ec69f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.965241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ed941-ea45-4d9e-b2bd-ba6665d2aa3a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:11.965564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97809a73-5395-4288-ba88-11726b7ec69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-97809a73-5395-4288-ba88-11726b7ec69f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:11.970123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:11.971164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:11.971987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 245/502] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:11.972631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486eac6-dd8b-4a66-b728-683d804ed43a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:11.972878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486eac6-dd8b-4a66-b728-683d804ed43a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:11.973166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486eac6-dd8b-4a66-b728-683d804ed43a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:11.974367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 246/503] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:11.975044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486eac6-dd8b-4a66-b728-683d804ed43a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.002550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.003146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.003419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.003691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.004318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:12.004611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.006399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.018426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 258/504] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:12.019233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.035232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.077732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486eac6-dd8b-4a66-b728-683d804ed43a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.110779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.111399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.111670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.111932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.114318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.117486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1147cc-d8d1-4897-a194-39b6d1f7a86f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.125033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.125187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:12.141032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:12.142041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:12.142867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:12.142867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:12.142867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:12.142867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 247/505] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:12.143089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.155271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.155847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.156139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.156399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.157033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:12.157319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.158698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab83533-050d-4ea6-aaa8-08418f9b321f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.169691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 259/506] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:12.170891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.171166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.171413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.188386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:12.189584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:12.240790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86908a84-b038-46c6-a7c1-7c3c01001b8c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.251254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.254809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 260/507] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:12.256195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.277284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.278264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.278532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.278788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.279429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:12.279708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.281090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.289553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 248/508] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:12.290357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.351732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.361611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe654f-c372-4437-88d1-10e63fa36301 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.388908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65adda-3114-4e39-92dc-f7374738611e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.395705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.396356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.396627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.396894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.403863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.405326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:12.416360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:12.417449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:12.418509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 261/509] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:12.419158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.426065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.426674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.426946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.427211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.427840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:12.428133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.429632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.441872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 249/510] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:12.442675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.473176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.539330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995822e-12e7-49a8-be9c-98b78973d91e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.540620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cae016-338e-4b2f-8b5d-789ba68ff06d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.572889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.573206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.573535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.573806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.573901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.574070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.574163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.574339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.581662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.583093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.584151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.585698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:12.593838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:12.594910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 262/511] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:12.595947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:12.602823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:12.603893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:12.604927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:12.604927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:12.604927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:12.604927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 250/512] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:12.609355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.609750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.693966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.696491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bce9c-b967-4542-b897-1dcdba76ac08 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.711038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858fdb6-681e-4e69-927a-6d87409ad0b4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.729901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.730523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.730797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.731103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.741474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.742941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.744529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.745157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.745439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.745703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.746414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:12.746712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.748146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:12.757120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:12.758158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:12.763899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:12.763899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:12.763899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:12.763899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 263/513] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:12.763899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.766237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 251/514] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:12.767040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.821497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.862699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e06c-b325-4406-8aff-ad819cfb6d75 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.887292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc317a-9726-4a14-a64a-d52f26762959 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:12.896845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.897501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.897777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.898040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.904638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.906131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:12.917878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:12.918750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:12.919608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 264/515] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:12.920079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:12.923515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:12.924229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:12.924508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:12.924779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:12.925525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:12.925818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:12.927246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:12.941217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:12.945299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 252/516] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:12.946339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.023704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70601d1-29f2-4774-87df-a4aeb90b395f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.041811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a2872-5953-4ea8-9bda-7dcdb172b3c5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.046490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.058577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.059183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.059456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.059724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.060365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:13.060663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.062093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.073548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 265/517] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:13.074334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.079304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.079903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.080174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.080432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.081118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:13.081411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.082744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.094640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 253/518] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:13.095423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.166264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.181208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c654a-59af-4b4d-ae4e-1a5f9a166ff0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.207151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93edb-f449-4de0-89d5-1ac8d97a2e7b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.214718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.215320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.215588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.215853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.240499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.241141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.241439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.241699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.242372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:13.242665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.244074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.261465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 254/519] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:13.262250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.270707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.289411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.290861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.362692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386e07-f362-4ce9-82c9-c103220bd6c8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.383172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.389369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 266/520] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:13.389369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.398516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.399121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.399392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.399646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.465479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.469353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.470896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.483900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56857fdc-4431-4198-a72f-56dc090f90bf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.519514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.520107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.520378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.520636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.521298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.522760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.544081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 267/521] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:58:13 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:13.544877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.570984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 255/522] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:13.575936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.597810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.668672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc667-467c-4f6a-9266-798911cf589d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.684754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d7011-9855-4c14-9cc9-7418cd9225bd None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.710319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.711591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.711591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.711591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.722884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.723996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.724337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.724611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.724885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.725182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.725970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=ded8e23edf404c378eba94e917be0c8e) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:13.726311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.726424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.727808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.734439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 256/523] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/role_assignments?user.id=ded8e23edf404c378eba94e917be0c8e&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:13.735739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:13.741236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:13.742191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 268/524] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:13.743108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.840853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:13.860216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71229-2ca1-4fc6-8d19-5aa6b6a60d67 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.886936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad970fa8-f0b3-4bd6-a60c-5b63f8b53fbf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:13.901178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.902603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.903122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.903774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.917862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.920808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.928924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:13.930011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:13.930304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:13.930566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:13.938935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:13.940027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:13.940867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:13.940867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:13.940867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:13.940867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 257/525] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:13.940867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:13.949361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:13.950845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:13.968934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:13.970132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:13.971256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:13.971256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:13.971256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:13.971256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 269/526] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:13.971531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.045461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.058368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54649c9-3680-44d6-baa2-efcf71115ae3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.095088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.096144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.096510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.096906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.097749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:14.098133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.098536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc645-3f33-4aa5-8b03-818a9903ae7c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.099738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.103808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.126406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 258/527] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:14.127551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.147508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.148110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.148378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.148638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.149417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:14.149714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.151182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.169028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 270/528] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:14.169028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.245401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619ea1-44d4-4bd4-b544-b2cfe7972e40 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.280501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.281302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.281686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.282043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.282905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:14.283159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.284671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.289713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b118da4-75a5-405e-8364-bd53ff656589 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.297040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 259/529] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:14.298482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.302360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.328300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.329302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.329754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.330189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.357506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.403881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.405738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.406088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846c66-396c-40d3-8ef1-ccb197295dbd None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.442027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.442224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.442475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.442728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.449938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.451477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:14.464145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:14.465023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:14.465876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:14.470104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 260/530] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:14.471038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.517212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 271/531] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:14.518499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.536931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.580082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924871e6-0dbf-46f2-993d-1bb31ac1dbcc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.594860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.616339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.617289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.617733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.618175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.625451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.627180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.635552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a02c1f-4201-4dac-bbae-b70e7c45ccb4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:14.639835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:14.640644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:14.641697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:14.644117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 261/532] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:14.645207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.671756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.672385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.672703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.673143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.673826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:14.674191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.676047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.696290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 272/533] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:14.697414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.759891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2563a-ef58-460b-8fad-b5418f39eea1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.773030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.798435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.799436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.799907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.800356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.813004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.814868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.815885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01e400-36c6-4e31-8eaa-e8bf7273f3ce None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:14.829731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:14.830670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:14.831508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:14.831508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:14.831508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:14.833536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 262/534] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:14.834597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.860488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.861611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.862078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.862529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.863477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:14.864093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.866129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.875859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:14.886878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 273/535] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:14.888233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:14.954957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467288d0-027a-4f40-ad64-11b06570a0b0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:14.990669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:14.991308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:14.991585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:14.991847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:14.992665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=f1d18e6612024b4cbef06e5da57d4bbc) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:14.992987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:14.994418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:14.995754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b53b1-a59d-4885-a0df-7d9133d8c763 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:15.000431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 263/536] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/role_assignments?user.id=f1d18e6612024b4cbef06e5da57d4bbc&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:15.001317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:15.028452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:15.046703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:15.047735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.048195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.048674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.049643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:15.050129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:15.051887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:15.074708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 274/537] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:15.081712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:15.106608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:15.120076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f877-d31d-46df-8564-6b05bcfc82c8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:15.157343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:15.158060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.158354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.158619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.159458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=b1604862a92742d8bd8d1ca837a63c56) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:15.159772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:15.161306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:15.167790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 264/538] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:15 2022] GET /identity/v3/role_assignments?user.id=b1604862a92742d8bd8d1ca837a63c56&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:15.233338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89911-78b8-4720-bb43-9d04ea3b5ba0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:15.273834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:15.274483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.274755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.275025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.283152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:15.284528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:15.296734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:15.298205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:15.299580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 275/539] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:15.303874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:15.466352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5bde-4431-4b85-a03a-4fb2318cdce0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:15.508122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:15.508747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.509039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.509310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.510013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:15.510312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:15.511777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea99410-c76a-4de4-8e41-9f97b2b9262e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:15.524893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 265/540] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:15.534146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:15.607448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:15.673133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ff019-94d0-49b1-bf2a-60bf5786242f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:15.720620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:15.721299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.721579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.721845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.722587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=fef62b1004224069a326d0ce684e9307) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:15.723116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:15.724362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7b3d3-5929-4859-8968-b483bdf2c942 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:15.730839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 276/541] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:15 2022] GET /identity/v3/role_assignments?user.id=fef62b1004224069a326d0ce684e9307&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:15.742375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1572e-d7a5-4150-a1f5-9492bb19429e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.742647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1572e-d7a5-4150-a1f5-9492bb19429e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.742907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1572e-d7a5-4150-a1f5-9492bb19429e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.744509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 266/542] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:15.750174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f163c7-eab1-4dfb-b2e9-c5927087dc75 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:15.750453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f163c7-eab1-4dfb-b2e9-c5927087dc75 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:15.750726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f163c7-eab1-4dfb-b2e9-c5927087dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:15.774847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-21f163c7-eab1-4dfb-b2e9-c5927087dc75 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:15.776077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-21f163c7-eab1-4dfb-b2e9-c5927087dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:15.864864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 277/543] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:15.899054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1572e-d7a5-4150-a1f5-9492bb19429e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:15.921709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.023809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da1c3-52a3-495d-932c-efc8a90fb027 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.023809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da1c3-52a3-495d-932c-efc8a90fb027 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.023809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da1c3-52a3-495d-932c-efc8a90fb027 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.024538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 278/544] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:16.029059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.029562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.030016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.031847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1572e-d7a5-4150-a1f5-9492bb19429e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.069300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:16.070811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:16.072456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.075515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.075990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.076457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.100649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:16.105656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:16.106537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:16.107324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:16.116452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 267/545] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:16.128826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.153351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.201851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 279/546] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:16.224899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.297372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.328846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3756-488e-4996-a1de-f0ac8e0aa4af None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.360730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784098-ba0b-4f05-9156-1b6b06cffa94 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.365752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.366733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.367207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.367685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.379501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:16.385224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:16.386114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:16.386911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:16.389682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 280/547] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:16.395683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.409806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.410381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.410657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.410926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.411586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:16.411888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:16.413544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:16.424651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 268/548] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:16.429842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.457426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.503690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c191-2585-481f-b24b-7d695d93ebb4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.544672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.545716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.546248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.546731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.547681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:16.548211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:16.549950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:16.559816 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 281/549] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:16.565622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.646006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea457c-6152-4f70-9f38-613575b40ca4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.684693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f72a6-3abd-44df-86ac-df1844139e83 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.701315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.709706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.710374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.710648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.710913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.713758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.725069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.726826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.727337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.727797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.732145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:16.733627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:16.740461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:16.742528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:16.758339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:16.759512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:16.760382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:16.760382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:16.760382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:16.762490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 282/550] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:16.766741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:16.767633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:16.768538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:16.768538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:16.768538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:16.768538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 269/551] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:16.770552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.772092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.884547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c7a3-cdde-4756-8579-5453d482d360 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.924605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.925584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.926081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.926590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.927530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:16.928026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:16.929727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:16.942776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 283/552] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:16.944882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a772456-6b70-413b-9ae7-c8e1f40f3cb2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:16.957998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:16.983287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:16.983896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:16.984168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:16.984430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:16.985077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:16.985371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:16.990789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:16.990929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:16.999076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 270/553] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:17.004529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.054119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.103936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eb7f4-c1c2-4a23-b7d6-23662c7ff34a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.121890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8b949-c2c2-4c1b-a26c-b4baf92bcf25 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.180700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.181283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.181558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.181825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.183562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.184194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.184462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.184749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.197878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.199354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.200447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.201908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:17.220806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:17.221926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:17.222841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:17.227107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:17.229230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:17.232243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:17.238258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 271/554] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:17.238412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 284/555] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:17.238550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.238691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.357207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.404727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d553-0aae-4a96-b97d-3766bedd7aad None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.414801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58c641-a313-4012-920c-0d7f6b8f748d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.433590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.445016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.445639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.445909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.446173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.446895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:17.447189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.448625 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.479121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.480114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.480611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.481095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.482080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:17.482579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.484294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b62020-0f44-4d2b-8426-61fa05aa6d02 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.485838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 285/556] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:17.494097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.516710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 272/557] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:17.518246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fd4c3-0a61-449a-87de-9551de798ef3 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.518692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fd4c3-0a61-449a-87de-9551de798ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.519117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fd4c3-0a61-449a-87de-9551de798ef3 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.520672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 273/558] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:17.521594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fd4c3-0a61-449a-87de-9551de798ef3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.613350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69438-bbe0-4283-b989-a6acc083b608 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.642397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.651409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fd4c3-0a61-449a-87de-9551de798ef3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.652370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.653126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.653523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.653866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.667543 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.670018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8c9a7ac6-8d10-4fbb-a16d-dcaf45cb6431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:17.689667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:17.690836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:17.691934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:17.691934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:17.691934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:17.692710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0592e-a531-42d5-a75b-312ebf3012b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.693467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0592e-a531-42d5-a75b-312ebf3012b8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.693828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0592e-a531-42d5-a75b-312ebf3012b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.694160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 286/559] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:17.694358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0592e-a531-42d5-a75b-312ebf3012b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.695645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69099e-0436-4497-848c-7abc2817285f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.696071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69099e-0436-4497-848c-7abc2817285f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.696476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69099e-0436-4497-848c-7abc2817285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.719698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2e69099e-0436-4497-848c-7abc2817285f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:17.721572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2e69099e-0436-4497-848c-7abc2817285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:17.734666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.772639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0592e-a531-42d5-a75b-312ebf3012b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.774199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0592e-a531-42d5-a75b-312ebf3012b8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.801007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 287/560] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:17.801007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69099e-0436-4497-848c-7abc2817285f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.879697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 274/561] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 10:58:17.879697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4c4e-4f1b-419e-aeb4-9bdfb1161140 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.879697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4c4e-4f1b-419e-aeb4-9bdfb1161140 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.879697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4c4e-4f1b-419e-aeb4-9bdfb1161140 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.879697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 275/562] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:17.879697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4c4e-4f1b-419e-aeb4-9bdfb1161140 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.908721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69099e-0436-4497-848c-7abc2817285f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:17.918376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.946458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:17.947004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:17.947260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:17.947530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:17.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:17.948469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:17.949884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:17.950403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:17.961896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 288/563] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:17.962775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:17.991805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4c4e-4f1b-419e-aeb4-9bdfb1161140 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.026068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1abf-7768-4d96-88e0-c475faff0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.026688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1abf-7768-4d96-88e0-c475faff0560 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.026950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1abf-7768-4d96-88e0-c475faff0560 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.027211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1abf-7768-4d96-88e0-c475faff0560 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.037885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e1abf-7768-4d96-88e0-c475faff0560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-212e1abf-7768-4d96-88e0-c475faff0560 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:18.042570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.043522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 276/564] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.049755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.050525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.050525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.066371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:18.067573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:18.072630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6992-9f2a-454f-bdac-1a4000edb0eb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.105358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.105979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.106255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.106512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.117182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.118650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:18.134427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.135483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:18.136387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:18.136387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:18.136387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:18.137378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 277/565] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:18.138233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.140361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 289/566] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.141202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.163520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.194439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.238613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd410be-86e3-4267-8872-1f2f4287f35c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.239495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6cbe-9bf1-4b4c-ae5a-71eac56fedd7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.273402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.274044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.274306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.274566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.274806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.275403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.275674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.275938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.276593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:18.276886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.278296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9453c-ee90-4c9d-a810-42931d96ca4d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.281414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.282824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.286027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 290/567] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:18.287222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddd7bb-c118-41ce-a3dd-e8ce25dcbf1b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.287503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddd7bb-c118-41ce-a3dd-e8ce25dcbf1b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.287767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddd7bb-c118-41ce-a3dd-e8ce25dcbf1b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.289152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 291/568] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:18.289723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddd7bb-c118-41ce-a3dd-e8ce25dcbf1b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:18.297530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.298431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:18.299387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 278/569] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.299877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.376011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.395127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8b745-f6b1-4dc1-a851-03fe830c45b0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.395993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddd7bb-c118-41ce-a3dd-e8ce25dcbf1b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.411707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.429035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.429448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2374e-8353-4f39-9475-f585d442fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.429632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.429909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.430061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2374e-8353-4f39-9475-f585d442fa83 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.430172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.430330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2374e-8353-4f39-9475-f585d442fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.430588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2374e-8353-4f39-9475-f585d442fa83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.430803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:18.431094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.432548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.440214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2374e-8353-4f39-9475-f585d442fa83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:18.444407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 292/570] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-03b2374e-8353-4f39-9475-f585d442fa83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:18.445132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.446091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:18.446927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:18.447550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.447620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 279/571] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.447620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.447749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.448304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.465796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:18.467026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:18.533422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 280/572] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:18.534249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.546516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645813d-0ee9-42e8-964c-0b03c05bd712 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.580372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.581291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.581570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.581836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.591941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.593426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.595139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:18.608718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.609691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:18.610587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:18.610587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:18.610587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:18.610587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 293/573] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.610806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.640276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63068-43c2-4b12-9ac7-fcb17aa5e406 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.647320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.676083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.676681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.676950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.677241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.677924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:18.678223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.679696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.690709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 281/574] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:18.691489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.714735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36022a8-5ea2-4432-b749-7a801e5d2152 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.748793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.749456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.749732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.750023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.757153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.758594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:18.769586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.770444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:18.771312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:18.773325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 294/575] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.774005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.792562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18cead-95a2-470f-9a64-bc648c84c3b5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.824685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.825326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.825602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.825867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.826538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:18.826819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.828234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.829408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.836352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 282/576] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:18.837164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.864080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:18.875336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481caf-44f7-439c-b18d-7b01422e193d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.908899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.909542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.909811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.910070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.919744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:18.924844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:18.925784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:18.926615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 295/577] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:18.927312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:18.940252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd013-878b-4425-8e85-464f69658f01 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:18.980363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:18.980998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:18.981277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:18.981537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:18.982177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:18.982471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:18.983872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:18.996297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 283/578] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:18.997127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.030113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2134be-4199-4bf9-aaa6-9cab880123d3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.043829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.063702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.064364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.064632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.064896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/ded8e23edf404c378eba94e917be0c8e/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.078664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=ded8e23edf404c378eba94e917be0c8e, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.080089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.085417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.093765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 296/579] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:18 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/ded8e23edf404c378eba94e917be0c8e/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:19.094547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.098771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b107d7-ef84-4274-98c3-4e4beaed338a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.145937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.146881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.148122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.148391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.149194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:19.149506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.150978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.165400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 284/580] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:19.166867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.208216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1312-497e-43a1-93d9-e6d167c70fd2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.254030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.254693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.255322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.255586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.271124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.272813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.282534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a0669-02f6-4cc5-8b45-41e0a76aa3b7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:19.293381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:19.294373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:19.294373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:19.294373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:19.294373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 297/581] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:19.294890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.324637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.328683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.329329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.329610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.329881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.330544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:19.330842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.332245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.346606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 285/582] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:19.346606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.357434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.422673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9becb04-efdf-41d3-98e7-5fdaf82ef5a0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.450223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afc56-aa59-4925-bb56-67913f3b7ed9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.457759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.458393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.458667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.458931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.466638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.468086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:19.479444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:19.480377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 298/583] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:19.481724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.489991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.490604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.491143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.491246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.491896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=8553125282aa414db923858f1e27c76f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:19.492204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.493686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.499903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 286/584] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/role_assignments?user.id=8553125282aa414db923858f1e27c76f&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:19.506438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.571397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.609830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f2044-d76e-457a-8791-1d2b4042783b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.614788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.650526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f728-bc1c-4c42-9204-23cfaadefe42 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.652562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.653438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.653915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.654372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.655409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:19.655904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.657672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.671278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 299/585] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:19.672502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.696280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.696925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.697230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.697498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.713283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.714771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:19.734076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:19.735059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:19.735929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:19.735929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:19.735929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:19.740095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 287/586] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:19.741670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.788269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dbd83-9d11-4b2e-b512-6af3758a3401 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.825419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.826411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.826918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.827387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.828294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:19.828846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.830472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.833709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.851787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 300/587] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:19.853164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.868152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a0687-92a8-441d-88f6-3683f3f2ef62 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:19.905353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:19.909843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:19.910945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:19.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:19.911494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:19.921789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:19.923277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:19.937225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:19.938196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 10:58:19.939246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:19.943456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 288/588] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:19.944344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:19.966572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faefae-710e-45ea-b0e7-76590b36e32c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.003952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.004933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.005796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.006247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.007120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:20.007604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.009207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.021135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 301/589] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:20.022250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.060244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f111dc-a59c-4108-95bc-8e7b648dc1c7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.078369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.098203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.098834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.099110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.099374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.111166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.112612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.126348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898aee6-28d3-42f8-a750-4d5795681a46 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:20.128278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:20.129211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:20.130463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:20.130463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:20.130463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:20.134522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 289/590] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:20.135445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.165877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.166845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.167213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.167577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.168396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:20.168789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.170358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.178720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.188450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 302/591] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:20.189525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.248943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653bbe5-f7fb-4d43-89f2-75c944643c94 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.287046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.287991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.288441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.288866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.292873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd021de-2757-4d0b-ae25-ee00cde2406b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.297503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.299145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.306824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:20.312469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:20.313802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 10:58:20.314972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:20.317993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 290/592] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:20.318907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.331045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.331863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.332227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.332589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.333363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:20.333806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.335296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.351342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 303/593] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:20.351342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.429126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.433926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a6e3-e261-41c2-bd2f-7d46786e9260 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.445795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aecda1-9c08-43a8-aeea-bfc60a632774 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.471493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.472428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.472846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.473304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.479859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.480872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.480872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.481268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.482088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:20.482482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.484009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.485866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.487532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:20.503634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:20.504755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:20.506095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:20.506095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:20.506095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:20.509306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 291/594] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:20.510272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.515833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 304/595] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:20.521497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.561206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.637701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e5746-b7dd-4c6d-9b34-e6c172f98667 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.663372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6eebd-815b-44d1-83fd-3aeb803dd448 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.683572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.684512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.684934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.685369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.692818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.694845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.706615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:20.706974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:20.708001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:20.709182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:20.709621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.709621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.709621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.709621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:20.709621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.710199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.716226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 292/596] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:20.717557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.723896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 305/597] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:20.728581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.739178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.834364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:20.846243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5892c-483a-4e1a-9107-e001dfc499cd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.850669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104f48-2f49-4050-ad12-ac8d965b8755 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:20.910034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.910899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.911318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.912431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.913395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:20.914184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.916228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.922635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:20.923460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:20.923879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:20.924298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:20.946783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 306/598] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:20.948815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:20.950291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:20.952048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:20.981560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:20.982591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:20.983506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:20.983506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:20.983506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:20.993464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 293/599] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:20.994617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.109505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:21.115068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458044-8be9-4630-b3bf-b7d50deab0d3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.151565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.152540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.152882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.153179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.158031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff679e-1312-4730-98fa-296c7f431989 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.159954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.161497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:21.173438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:21.174401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:21.175303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:21.179519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 307/600] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:21.180386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.192409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:21.207794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df55d3-86fd-46c5-baa1-0dc47d4ed62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.208900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df55d3-86fd-46c5-baa1-0dc47d4ed62e None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.209419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df55d3-86fd-46c5-baa1-0dc47d4ed62e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.209908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df55d3-86fd-46c5-baa1-0dc47d4ed62e None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/b1604862a92742d8bd8d1ca837a63c56/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.226333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df55d3-86fd-46c5-baa1-0dc47d4ed62e None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=b1604862a92742d8bd8d1ca837a63c56, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.228134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df55d3-86fd-46c5-baa1-0dc47d4ed62e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.253353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 294/601] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:20 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/b1604862a92742d8bd8d1ca837a63c56/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:21.255286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e729-0363-4248-8475-f7413d8ec956 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.257259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e729-0363-4248-8475-f7413d8ec956 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.259095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e729-0363-4248-8475-f7413d8ec956 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.263023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 295/602] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:21.263023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e729-0363-4248-8475-f7413d8ec956 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.324672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fdc5f-6b7f-467e-8268-2e2c2641f43c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.397731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.398353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.399043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.399318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.399975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:21.400269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.401713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89d88-aa48-4e58-bf22-e7430fa9e1b6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.419545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 308/603] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:21.420848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.421224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.421618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.423994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e729-0363-4248-8475-f7413d8ec956 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.440042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:21.445152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:21.446464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:21.472658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.473634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.473905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.474171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.475359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:21.475672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.477672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.492468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 296/604] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:21.493722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.516027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 309/605] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:21.516532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:21.518429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.611638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b382c-345f-4a44-9dec-947331faed24 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.631739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182638-54e5-458c-a959-2da93b22aa3e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.650612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.651235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.651503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.651762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.658543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.659960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.666808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587da5b-dac7-444c-89e6-05c9e494f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.667471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587da5b-dac7-444c-89e6-05c9e494f210 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.667742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587da5b-dac7-444c-89e6-05c9e494f210 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.667998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587da5b-dac7-444c-89e6-05c9e494f210 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/f1d18e6612024b4cbef06e5da57d4bbc/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:21.671029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:21.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:21.672737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 297/606] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:21.673266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.688425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587da5b-dac7-444c-89e6-05c9e494f210 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=f1d18e6612024b4cbef06e5da57d4bbc, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.689922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587da5b-dac7-444c-89e6-05c9e494f210 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.704106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 310/607] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:21 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/f1d18e6612024b4cbef06e5da57d4bbc/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:21.706134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:21.714505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435cf7-5423-4e82-81a2-a6438f9b0e3b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.715083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435cf7-5423-4e82-81a2-a6438f9b0e3b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.716208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435cf7-5423-4e82-81a2-a6438f9b0e3b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.718208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 311/608] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:21.719259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a435cf7-5423-4e82-81a2-a6438f9b0e3b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.797355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:21.802791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140ba2-fadd-4dc0-b3bd-84537f998732 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.846856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b96d43-c097-4646-9d37-10e2546d433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.847505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b96d43-c097-4646-9d37-10e2546d433b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.847772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b96d43-c097-4646-9d37-10e2546d433b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.848032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b96d43-c097-4646-9d37-10e2546d433b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.860334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b96d43-c097-4646-9d37-10e2546d433b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:21.866099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a435cf7-5423-4e82-81a2-a6438f9b0e3b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f0b96d43-c097-4646-9d37-10e2546d433b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:21.866672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:21.867580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:21.868454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 298/609] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:21.869578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.869738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.870006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.889403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:21.890745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:21.909086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:21.909797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:21.910089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:21.910331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:21.911132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:21.911432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:21.912901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:21.927235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 312/610] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:21.928906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:21.976640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 299/611] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:21.977312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.009338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:22.051065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91b450-a53b-4c3c-860b-096971be98f0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.064757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:22.090897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9037c-945e-4c87-aae4-22064bbe4bc6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.096382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.097012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.097287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.097549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.098212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:22.098508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.100434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.111832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 313/612] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:22.112664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.142122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.143363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.143798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.144201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/fef62b1004224069a326d0ce684e9307/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.160007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=fef62b1004224069a326d0ce684e9307, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.161747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.177878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 300/613] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:21 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/fef62b1004224069a326d0ce684e9307/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:22.179024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.230999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa760-92f5-4ce8-ac5c-6c1db7c469cd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.268418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.269502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.269972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.270460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.277032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:22.292076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:22.299322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:22.300515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:22.301548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:22.304536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 314/614] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:22.310488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.327764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4565a-78d5-4cdd-921e-d0185b6b3f20 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.373814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:22.397621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.398264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.398530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.398789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.416441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.418975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:22.438355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:22.439310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:22.440188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:22.440188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:22.440188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:22.443151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 301/615] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:22.444650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.488364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2acf5-92c2-4b78-8127-719bdddc815b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.526458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.527065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.527337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.527602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.528277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:22.528554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.529969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.539380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 315/616] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:22.544374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.576044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9af1b-aff6-425d-8c8d-8b920129c895 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.603386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:22.616519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.617913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.618351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.618848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.619905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:22.620344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.622401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.641253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 302/617] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:22.649114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.718684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:22.735398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841efa-22d4-44b2-8308-9c946a092472 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.794545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.795500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.795921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.796322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.808995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.810455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:22.825649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:22.826598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:22.827461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:22.827461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:22.827461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:22.827461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 316/618] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:22.832192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.832698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561554c-fc00-4c37-9f59-9fdc33a80f1a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.879355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.880468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.880858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.881326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.892398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.894556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:22.911520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:22.912474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:22.913477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 303/619] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:22.931855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:22.953258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7bc6-fa72-480e-8b27-50f639b471c2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:22.992970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:22.996999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:22.996999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:22.996999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:22.996999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:22.996999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:22.996999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.017002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 317/620] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:23.017906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.029896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.030442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.140824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84b76-752a-42ef-91b3-dc4fc4992c98 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:23.180434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:23.181090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.181488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.181755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.190567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:23.192024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:23.204769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:23.205768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:23.206755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:23.207286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 318/621] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:23.212049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.225679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712fd1-ba0e-419b-8bd5-ee683404b093 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:23.263595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:23.264212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.264545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.264961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.265932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:23.266290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:23.267787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.291585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 304/622] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:58:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:23.292874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.325277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.387107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf70e-fcd7-4c60-8227-f23605f6da25 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:23.400195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e243f-ad1a-497e-88c4-19b35fe712cf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:23.401714 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.437144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d45d6-ef53-45b8-94e1-e55b26d65706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:23.437776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d45d6-ef53-45b8-94e1-e55b26d65706 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.438054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d45d6-ef53-45b8-94e1-e55b26d65706 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.438315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d45d6-ef53-45b8-94e1-e55b26d65706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.457959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:23.458799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.459181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.459551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.460770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:23.461231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:23.463552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.504607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 319/623] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:23.507550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d45d6-ef53-45b8-94e1-e55b26d65706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:23.509198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d45d6-ef53-45b8-94e1-e55b26d65706 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.510237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.615090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 305/624] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 10:58:23.616678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297361-812b-4be8-ae17-415d74df6cb9 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.616955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297361-812b-4be8-ae17-415d74df6cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.617253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297361-812b-4be8-ae17-415d74df6cb9 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.619411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 306/625] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:23.620343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49297361-812b-4be8-ae17-415d74df6cb9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.625421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.682377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794deb-4bfc-44ab-b3f5-a2af9d6cf53d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:23.724329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.746648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:23.747912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.748786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.749266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.764460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:23.764682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49297361-812b-4be8-ae17-415d74df6cb9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:23.766611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c45222d5-85b7-4e0c-90fa-09d48121144c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:23.795175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:23.796203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:23.797158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:23.797158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:23.797158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:23.803571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 320/626] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:23.804990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.805276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.805542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.810546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:23.811729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:23.812203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:23.813367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:23.823743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:23.825048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:23.831036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:23.833536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:23.857768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:23.858747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:23.859645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:23.859645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:23.859645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:23.861474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 307/627] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:23.862412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.908916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 321/628] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:23.910137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:23.941156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:23.998468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59837dd8-d2cb-43a5-9f00-9ae9fa3e5960 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.028249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9134e31-b344-4527-8ee6-bd1f883c36aa None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.038094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.039557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.040177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.040655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.040830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.041517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:24.041859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.044154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.059298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 308/629] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:24.060439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.077324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.078424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.078837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.079236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.080229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:24.081111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.083131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.103881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 322/630] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:24.103881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.192564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc140fe-bd1a-4683-b305-ced44b7b1371 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.210076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.217538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef421-228c-453c-a21b-2a2ebda202f7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.233118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.234616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.235148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.235597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.247502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:24.251576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.252205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.252480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.252747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:24.253335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:24.254384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:24.255749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:24.257854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 309/631] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:24.258808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.262243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.264251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-13a0d8d0-a3a9-4b15-9761-2b23cd69a9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:24.275367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:24.276380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 323/632] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354eeff-0f26-4231-9cba-d0876a0d97ed None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.282481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354eeff-0f26-4231-9cba-d0876a0d97ed None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.283095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354eeff-0f26-4231-9cba-d0876a0d97ed None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.283095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 324/633] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:24.283095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354eeff-0f26-4231-9cba-d0876a0d97ed None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.313908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.371533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed2805-6111-42db-b569-72d5182f6b73 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.396993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354eeff-0f26-4231-9cba-d0876a0d97ed None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.409029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.409795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.410072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.410403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.417424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.419284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2b45c432-bd53-43fe-98d5-2932d9afbd01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:24.430962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:24.431910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:24.432807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 310/634] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:24.433326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.433927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.433927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.439259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.439867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.440140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.440404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.441088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:24.441385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.442821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.451478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:24.456930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 325/635] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:24.457096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:24.457175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.481307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.525032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 311/636] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:24.525032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.564551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.577418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df374c1-1f28-4a3f-a1da-507b0f9e1ac4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.612337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.612947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.613257 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.613522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.614204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:24.614509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.615977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.627735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 326/637] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:24.628552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.644826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d859-87dc-4c7d-a96e-696d5547ac33 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.679790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.680394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.680665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.680926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.681648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:24.681945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.683359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.695267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 312/638] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:24.696005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.723997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.749883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea77f-e8fc-4e25-8bfe-d72a309d872a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.784531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.785218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.785525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.785823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.798742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.800817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.800995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f118-c822-4379-a8e7-0ec6536bdc08 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.809189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:24.815868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:24.816968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:24.818014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:24.818014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:24.818014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:24.818014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 327/639] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:24.818397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.840297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aa651-4d20-40b8-a0e5-0539c853ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.840934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa651-4d20-40b8-a0e5-0539c853ff31 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.841235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa651-4d20-40b8-a0e5-0539c853ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.841502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa651-4d20-40b8-a0e5-0539c853ff31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.851997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aa651-4d20-40b8-a0e5-0539c853ff31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0a5aa651-4d20-40b8-a0e5-0539c853ff31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:24.857069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:24.858236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:24.859083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 313/640] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:24.859772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977c07-10c3-4431-919f-f2694b15bce0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.859839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977c07-10c3-4431-919f-f2694b15bce0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.860097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977c07-10c3-4431-919f-f2694b15bce0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.861359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 314/641] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:24.862034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977c07-10c3-4431-919f-f2694b15bce0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:24.923233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c313d-6c2e-4156-b099-e38b343356b7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.947965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:24.956683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:24.957378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:24.957656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:24.957922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/8553125282aa414db923858f1e27c76f/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:24.965289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977c07-10c3-4431-919f-f2694b15bce0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:24.972611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=8553125282aa414db923858f1e27c76f, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:24.974137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:24.986890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 328/642] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:24 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/8553125282aa414db923858f1e27c76f/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:24.987681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.005314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.005934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.006198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.006459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.007232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=ded8e23edf404c378eba94e917be0c8e) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:25.007528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.008999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.029151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 315/643] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/role_assignments?user.id=ded8e23edf404c378eba94e917be0c8e&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:25.029151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.067948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:25.148061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a2666-dea9-4c95-af5c-7d340ea690d5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.206453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.207005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.207312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.208478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.209220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:25.209527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.211676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28087a16-a47a-4fa4-abda-9b2e2791c424 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.212619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05f616-8be7-46ff-acb3-32eaff90af53 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.227253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 329/644] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:25.228368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.228895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.228895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.247585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:25.248766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:25.255651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.256265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.256570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.256837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.258038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:25.258335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.261739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.272904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 316/645] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:25.273790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.292379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:25.353471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 330/646] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:25.354298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.404423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:25.427706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb098-2b6d-4ace-af0c-3426a9cee8e8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.470521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.471931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.472373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.472777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.477578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699ad0-ae5f-4c00-83b9-40dc976c6b64 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.482798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.484406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:25.498936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:25.500070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:25.501340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:25.509057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 317/647] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:25.509057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.524652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.525497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.525862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.526224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.540073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.541887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:25.560608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:25.561829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:25.562910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:25.562910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:25.562910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:25.568940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 331/648] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:25.571139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.603350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:25.644296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efe4eb-1e91-4440-8caf-1eb75a21df6e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.689416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.690055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.690328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.690592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.696523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:25.707037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:25.710098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f714e-b3f8-4583-ad18-2ad5620f2775 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:25.713418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:25.714335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:25.715576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:25.725821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 318/649] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:25.725821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.756764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.757421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.758001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.758270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.759012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:25.759313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.760763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.782837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 332/650] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:25.783695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.849652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf6756-9ea7-4f71-8dc0-084c695f1892 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.884614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:25.891797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.892405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.892679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.892940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.893753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:25.894051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.895988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.897997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485709-48e8-4262-b9c3-2677ab661dc1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:25.913722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 319/651] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:25.913722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.944863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:25.945944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:25.946975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:25.947540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:25.949400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:25.950042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:25.952279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:25.965785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 333/652] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:25.967037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:25.983182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.038536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e95970-650c-4d9f-b7d7-463b5c5456ef None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.072789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.073664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.074012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.074369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.079090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873c47-2e3a-4b4e-91c3-f3ae63a6150e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.126252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.126252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.126252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.126252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.135690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.138351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:26.155382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:26.156604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 10:58:26.157637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:26.158380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.159192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 334/653] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:26.160876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.183647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.185525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.256917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.290720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3780d2-b063-44ed-961f-083ef54deb1d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.294354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 320/654] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:26.295331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.329038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.329963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.330403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.330819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.343066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.344917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:26.360892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:26.362145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:26.363178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:26.363178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:26.363178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:26.364889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 335/655] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:26.366069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.394006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.406581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60e6ed-4974-4f80-bcdb-4fdccf068089 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.453144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.453856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.454131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.454606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.455774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:26.455774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.457313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.483822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 321/656] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:26.483822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.503463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d0be2-8053-41c3-8677-5641ede3d656 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.530138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.542588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.543324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.543665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.543998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.556820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.558295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:26.573624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:26.575263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:26.576308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:26.576308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:26.576308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:26.576488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 336/657] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:26.577526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.601222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf108f-0adf-498b-b70d-dcd321d83c8d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.637428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.638395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.638866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.639310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.640233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:26.640713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.642377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.655125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 322/658] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:26.656234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.667875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.723907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f7ac0-5b92-4780-b143-e8aeace394ea None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.767265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3aad0-9d87-47a2-a060-78d184dde5a7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:26.783422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.784500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.784916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.785597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.812206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:26.813123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:26.813392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:26.813650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:26.814541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:26.814860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.816858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.834954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 323/659] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:26.835833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.841359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.866005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:26.867461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:26.930058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:26.978758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 337/660] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:26.978758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:26.982108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27876a1-3558-4f9b-bbac-837b7bff85ad None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.018591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.019571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.019987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.020384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.028342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.030197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:27.042791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:27.043767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 10:58:27.044781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:27.047383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 324/661] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:27.048451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.062527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.088254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3d16-b3d7-4fc8-a454-4381f51f39a8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.132775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.133653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.134203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.134630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.142582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.144062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:27.155665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:27.156695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 338/662] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:27.157694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.167823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901549fd-00a4-4155-9e43-1c95c8b704c1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.194878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.204760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.205724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.206141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.206406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.217387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.218826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2374d5a4-f9cb-4777-ac00-0c020f064040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:27.232548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:27.233514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:27.234420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:27.234420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:27.234420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:27.234420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 325/663] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:27.234963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051122b-f561-483c-b22f-413ccbeeaf09 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.235108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051122b-f561-483c-b22f-413ccbeeaf09 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.235377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051122b-f561-483c-b22f-413ccbeeaf09 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.236737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 326/664] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:27.241331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051122b-f561-483c-b22f-413ccbeeaf09 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.274309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807963b-1504-43df-b041-1ba0c81a1b5f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.310131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.310646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.310917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.311181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.312606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:27.312907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.314381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.317098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.339997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 339/665] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:27.339997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.370298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051122b-f561-483c-b22f-413ccbeeaf09 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.403673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.404271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.404549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.404811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.405497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:27.405786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.407198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccdff-f915-46ea-b60c-950681e551c2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.418907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 327/666] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:27.420050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01324-b6a8-4ba6-92ad-fa633c60082c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.420333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01324-b6a8-4ba6-92ad-fa633c60082c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.420594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01324-b6a8-4ba6-92ad-fa633c60082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.441984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-54e01324-b6a8-4ba6-92ad-fa633c60082c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:27.443163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-54e01324-b6a8-4ba6-92ad-fa633c60082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:27.446313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579d8d-a479-4f2c-9ef4-6142ff292da7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.479834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.484837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.485469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.485742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.486003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.486646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:27.486935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.488301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.499617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 340/667] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:27.500203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.517693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 328/668] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:27.518851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825387f-5ddc-4e51-b2e5-6833c7e67825 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.519129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825387f-5ddc-4e51-b2e5-6833c7e67825 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.519394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825387f-5ddc-4e51-b2e5-6833c7e67825 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.525165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 329/669] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:27.525165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825387f-5ddc-4e51-b2e5-6833c7e67825 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.560081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.606554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e37b98-8f62-4843-ac52-87ef5540b6ed None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.623505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825387f-5ddc-4e51-b2e5-6833c7e67825 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.639542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6b3e0-f5d1-4fed-852a-8112f8109558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.640141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6b3e0-f5d1-4fed-852a-8112f8109558 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.640413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6b3e0-f5d1-4fed-852a-8112f8109558 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.640953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6b3e0-f5d1-4fed-852a-8112f8109558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.657602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.658198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.658473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.658738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.659451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=b1604862a92742d8bd8d1ca837a63c56) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:27.659754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.661226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.667576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 330/670] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/role_assignments?user.id=b1604862a92742d8bd8d1ca837a63c56&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:27.668353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.709966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6b3e0-f5d1-4fed-852a-8112f8109558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.710307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.711409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6b3e0-f5d1-4fed-852a-8112f8109558 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.772057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.795852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5b83-605a-45f4-84c8-8b4504f18aa4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:27.825173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 341/671] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:27.826777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.827059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.827342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.834112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:27.834788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:27.835711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:27.835711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:27.844133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:27.845675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:27.848535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:27.849759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:27.857112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:27.857989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 331/672] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:27.859514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.925716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 342/673] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:27.926688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:27.962103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:27.969686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d36f-cb8a-4c5a-8787-76791c2eb9a2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.006921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.007661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.007934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.008203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.024648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:28.027762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:28.028704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:28.029591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 332/674] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:28.030503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.036053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.056646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d36af5-e9d9-44ae-83f1-99ccc31c1229 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.092237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.092866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.093171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.093440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.103752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.105224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:28.122003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:28.122969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:28.123869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:28.123869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:28.123869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:28.123869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 343/675] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:28.124111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.153025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95c654-c8fe-470d-bde1-9e70b0ae3fc9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.189250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.189858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.190137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.190409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.191093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:28.191402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.192805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.204870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 333/676] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:28.205573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.221467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.241504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177e00-caf8-4e9e-881c-f2f0d15ceb02 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.276991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.277640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.277913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.278176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.281103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.289784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:28.295027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:28.296030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:28.296892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 344/677] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:28.297646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.323370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d93f3-46e1-4026-994d-491c853a7e2a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.360067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.360670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.361039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.361228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.361888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:28.362317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.363541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.371769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 334/678] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:28.372431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.410159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5063-acb9-4563-b78b-dad37176e89c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.444925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.445561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.445831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.446092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.446729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:28.447021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.448388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.452965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.465426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 345/679] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:28.465426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.484193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470ede1-b5ef-4cb1-90c0-6d1f75db1d79 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.520158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.520757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.521047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.521422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.522257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=f1d18e6612024b4cbef06e5da57d4bbc) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:28.522439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.522917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.523880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.541009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 335/680] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/role_assignments?user.id=f1d18e6612024b4cbef06e5da57d4bbc&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:28.541009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.586481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca39c9-ed94-41f8-bf08-a3ed8598da6f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.625529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.626193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.626306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.626553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.627212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:28.627506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.629026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.639155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 346/681] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:28.640024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.672116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33eb3-989b-4c32-8dbb-bdd8b3103bca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.714158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.715201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.715696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.716158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.729253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.735015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.736256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:28.752530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:28.753581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:28.754464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:28.754464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:28.754464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:28.754464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 336/682] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:28.754682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.778905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691dcc-80aa-4207-a2a8-92d2c0acb5b8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.805742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:28.835044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.836444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.836923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.837716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.848213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.850012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:28.864392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:28.865376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:28.866392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:28.868096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 347/683] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:28.872759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.889246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993124b8-e98d-4b69-bf5d-58e24262fa54 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:28.924848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:28.925621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:28.925897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:28.926240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:28.937905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:28.939342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:28.954307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:28.955281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:28.956188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:28.956188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:28.956188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:28.956188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 337/684] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:28.961166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:28.971715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55162ead-f7f6-4441-8075-f9fb68db896a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.006055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.006698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.006975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.007234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.007871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:29.008169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.009581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.010089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.026626 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 348/685] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:29.027521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.064351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc438a0-8772-4327-b575-d273e0c28ddf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.067501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.101168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.102015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.102479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.102910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.103870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:29.104812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.106578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.119928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 338/686] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:29.121125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.139553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc716-e11e-4f6c-9c1d-c141ddbaebaf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.176489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.177328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.177762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.178215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.179331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:29.179633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.183189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.202987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 349/687] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:29.203976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.234427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf8eef-29ee-423c-859f-7f1bfdb597e6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.237320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.271584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.272487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.272850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.273257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.281155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.282794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:29.295008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:29.296058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:29.297052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:29.301225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 339/688] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:29.302038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.324161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.329519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d85d83-e5d3-4a67-b39c-b0c0ed509713 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.367047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.367993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.368410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.368806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.369792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=fef62b1004224069a326d0ce684e9307) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:29.370262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.371967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.378982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 350/689] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/role_assignments?user.id=fef62b1004224069a326d0ce684e9307&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:29.380394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.415891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08b1c-1df4-4705-a195-b4e7b66e1b7c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.453003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.453846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.454215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.454636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.472012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.476394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:29.503249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:29.504488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:29.505882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:29.510533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 340/690] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:29.516605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.533831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208daafc-9b53-47ed-8c24-1651ea3651a1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.573141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.598437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.599414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.599881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.600403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.602260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:29.602780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.604530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.626110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 351/691] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:29.635040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.659020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.660581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60494ad4-3497-41ba-b1fe-8b0f54c97067 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.698090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.698637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.698886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.699147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.699871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:29.700164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.701788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0640e3-11ed-41af-93bc-613803428784 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.721460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 341/692] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:29.722801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b433-fe9e-4264-a0ce-80c294818ab3 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.723086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b433-fe9e-4264-a0ce-80c294818ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.723363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b433-fe9e-4264-a0ce-80c294818ab3 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.724847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 342/693] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:29.727145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b433-fe9e-4264-a0ce-80c294818ab3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:29.754363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d6855-a50b-431f-8253-2f36a4e83b63 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.792951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6092e2-0118-49b3-a0f5-01a624015368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.793790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6092e2-0118-49b3-a0f5-01a624015368 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.794019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6092e2-0118-49b3-a0f5-01a624015368 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.794359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6092e2-0118-49b3-a0f5-01a624015368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.826862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.848717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b433-fe9e-4264-a0ce-80c294818ab3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:29.879252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6092e2-0118-49b3-a0f5-01a624015368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.881358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6092e2-0118-49b3-a0f5-01a624015368 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.894318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:29.895212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.895494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.895763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:29.905547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:29.973790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:29.975341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:29.995428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 352/694] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:29.997062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:29.997489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:29.997908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.016240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:30.017848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:30.062096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.083421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 343/695] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 10:58:30.084351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.087380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 353/696] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:30.089203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.141680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.194080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df5f27-40d4-41cb-aa4a-5d281f88afb2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.196364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cbb75-14a7-4914-abe0-2229510ef140 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.230156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.230703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.230974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.231236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.232228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.232860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.233250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.233521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.242165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.243638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.244175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.245741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:30.259599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:30.260558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:30.262513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:30.262513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:30.262513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:30.262760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:30.263832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:30.264894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:30.264894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:30.264894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:30.266109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 354/697] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:30.266109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.266260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 344/698] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:30.273991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.310192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.368620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fc7e-3b55-499b-b8b3-49fbac3676e4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.370489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.386175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545295dc-18a7-456f-b94c-6636957615d7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.405982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.406861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.407277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.407778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.408548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.410089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:30.421747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:30.422981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:30.423919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:30.424770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.424770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.424770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.424770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.425401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:30.425401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.425538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.427211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 355/699] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:30.428299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.443975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 345/700] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:30.445215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.555871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb692e-25a5-4d5f-b1db-93f2e8b8ccaf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.559801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.573686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7b66-4632-4c6a-87f8-9fe130d8c040 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.594345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.594952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.595220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.595484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.596189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:30.596419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.597821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.610320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 356/701] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:30.611318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.621795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.623089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.623510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.623917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.625210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:30.625764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.627606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.634552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 346/702] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:30.635493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.646019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.735565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896500-c50b-4aad-90bf-3e51295a6163 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.752089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddbded-05b0-4ea6-a775-de8f93c0405e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.773513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.774530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.774947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.775355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.783023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.784732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.788676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.789341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.789613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.789931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.797074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:30.797482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:30.798514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:30.799576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:30.800003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.801758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 357/703] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:30.802764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:30.811392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:30.812363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:30.813398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 347/704] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:30.813889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.832706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.902478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:30.918817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeecb5-ce2b-43bc-b847-d6552bc0ef20 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.919133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbf4f-151d-4cf3-9500-19fc62f0ec37 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:30.954522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.955109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.955375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.955647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.956317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:30.956606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.958110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.962397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:30.963071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.963404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.963731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.964878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:30.965306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:30.967187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7bbcd-dffd-49a8-b1c0-54897b066946 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:30.975045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 348/705] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:30.975045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:30.981159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 358/706] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:30.982803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3992-fda3-4933-b4a8-f8be760ed9ae None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:30.983237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3992-fda3-4933-b4a8-f8be760ed9ae None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:30.983516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3992-fda3-4933-b4a8-f8be760ed9ae None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:30.985115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 359/707] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:30.990443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3992-fda3-4933-b4a8-f8be760ed9ae None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:31.086678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:31.110245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3992-fda3-4933-b4a8-f8be760ed9ae None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:31.119000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96028-d8e8-4a05-8581-71636666db0d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:31.162969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:31.163624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.163904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.164170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.164899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=8553125282aa414db923858f1e27c76f) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:31.165142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:31.165263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:31.165993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.166398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.166667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef8bb5-81ff-45bd-b657-3af439767a24 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:31.166989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.167813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:31.168261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:31.170484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:31.174979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 360/708] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/role_assignments?user.id=8553125282aa414db923858f1e27c76f&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:31.176323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.176700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.177102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.184882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 349/709] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:31.193036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:31.204229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:31.206301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:31.220694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:31.311932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33216b0-c796-468c-accd-fca4a8d2a957 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:31.376120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:31.376681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.376955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.377250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.378029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=ded8e23edf404c378eba94e917be0c8e) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:31.378334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:31.380224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:31.395753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 350/710] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:31 2022] GET /identity/v3/role_assignments?user.id=ded8e23edf404c378eba94e917be0c8e&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:31.445584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 361/711] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:31.470592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:31.473999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:31.603150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6242c-99f2-434b-8450-10f0ed13a3de None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:31.638349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:31.638910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.639184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.639451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.650542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:31.651999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:31.666471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:31.667513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:31.668435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:31.668435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:31.668435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:31.672621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 351/712] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:31.674038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:31.780468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cef6-7a24-47bc-885d-2032537cf125 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:31.815846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:31.816453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.816727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.817020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.817656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:31.817955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:31.819446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352932c-ad85-419d-8d84-6e465f862756 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:31.836602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 362/713] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:31.842094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:31.853505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f024c-70e2-4bb0-9b1e-bc04e8b99955 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.854134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f024c-70e2-4bb0-9b1e-bc04e8b99955 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.854599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f024c-70e2-4bb0-9b1e-bc04e8b99955 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.856422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 363/714] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:31.865533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:31.866200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:31.866666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:31.887749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:31.906946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:31.908029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:31.915965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:31.985758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 364/715] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 10:58:32.004238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df312d5-8180-48fb-9a86-9ec0abbc7230 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:32.018185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:32.068604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:32.070961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:32.072252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:32.072709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:32.073825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:32.076081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:32.119677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 352/716] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:58:31 2022] POST /identity/v3/users => generated 254 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:32.174206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47cdb5-9f82-4c41-83e7-8e3fab391a97 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:32.225627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:32.226285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:32.226675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:32.226993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] PATH_INFO: `/v3/services/network` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:32.227642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:32.229153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:32.231462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:32.239259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:32.240368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:32.241291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 365/717] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:32 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:32.246759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:32.389185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c953-f29d-4189-8a6e-567970065188 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:32.400073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:32.427051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:32.427593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:32.427865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:32.428130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:32.428791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] RBAC: Adding query filter params (name=network) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:32.429168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:32.430530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045d0c2-890f-4e6d-b82c-f94349e6b287 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:32.435622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 353/718] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:32.440876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:32.550416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e89ca-6b5c-4d00-981e-661108289a7e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:32.587986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:32.588936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:32.589416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:32.589874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:32.590753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] RBAC: Adding query filter params (type=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:32.591228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:32.593108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e247d1-f04f-4a4b-b93e-a5a086115a0d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:32.599032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 366/719] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:33.292098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4586a9-3746-4f68-a77c-1a2b261f45d2 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:33.292621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4586a9-3746-4f68-a77c-1a2b261f45d2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:33.292621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4586a9-3746-4f68-a77c-1a2b261f45d2 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:33.294429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 354/720] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:33.299663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ff3e-04e0-43af-bd64-cec6eb76149d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:33.300069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ff3e-04e0-43af-bd64-cec6eb76149d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:33.300210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ff3e-04e0-43af-bd64-cec6eb76149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:33.325121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7008ff3e-04e0-43af-bd64-cec6eb76149d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:33.326301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7008ff3e-04e0-43af-bd64-cec6eb76149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:33.390810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:33.403015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 367/721] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:33.424650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4586a9-3746-4f68-a77c-1a2b261f45d2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:33.527251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4586a9-3746-4f68-a77c-1a2b261f45d2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:33.560597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530daf9d-1500-46fc-9f76-35dc39c698bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:33.561293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530daf9d-1500-46fc-9f76-35dc39c698bf None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:33.561563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530daf9d-1500-46fc-9f76-35dc39c698bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:33.561826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530daf9d-1500-46fc-9f76-35dc39c698bf None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:33.562475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530daf9d-1500-46fc-9f76-35dc39c698bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:33.563825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530daf9d-1500-46fc-9f76-35dc39c698bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:33.590407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 355/722] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:58:33 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:33.833360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d0c8-2e4d-4291-ad25-2f46921211d8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:33.833751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d0c8-2e4d-4291-ad25-2f46921211d8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:33.833952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d0c8-2e4d-4291-ad25-2f46921211d8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:33.835431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 368/723] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:33.840453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e3d5-40d7-42c2-8bee-20df7b0f108c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:33.840734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e3d5-40d7-42c2-8bee-20df7b0f108c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:33.841021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e3d5-40d7-42c2-8bee-20df7b0f108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:33.859298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7bd9e3d5-40d7-42c2-8bee-20df7b0f108c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:33.860465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7bd9e3d5-40d7-42c2-8bee-20df7b0f108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:33.887699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:33.942145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 356/724] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:33.964635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d0c8-2e4d-4291-ad25-2f46921211d8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.069872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f69e7-6f6c-4aea-9f8a-c98b6198f729 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.070221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f69e7-6f6c-4aea-9f8a-c98b6198f729 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.070413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f69e7-6f6c-4aea-9f8a-c98b6198f729 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.072035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 357/725] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:34.077293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.077682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.078724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.080003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d0c8-2e4d-4291-ad25-2f46921211d8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.100628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:34.101929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:34.138308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.138988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.139263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.139535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.159532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:34.164384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:34.165354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:34.166204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:34.173779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 369/726] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:34.179478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 358/727] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 10:58:34.179699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.216569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.240959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:34.306421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1fbd0-bc46-4559-a387-6b38ac99b4c9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.332704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:34.344230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a55-30e9-481e-91f1-9b7956e9ba7b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.364751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.365317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.365593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.365910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.366588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:34.367249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:34.368366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:34.382203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.383138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.383598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.384073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.387804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 370/728] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:34.388859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.395382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:34.400445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:34.401626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:34.402459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:34.405033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 359/729] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:34.411120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.525455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a0f93-310c-40da-97a4-0fa577d8b0ae None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.568012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d21c9-2333-43fd-ba2a-32c83d1dc236 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.589722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.590677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.591161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.591630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.592482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:34.593044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:34.594624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:34.597316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:34.611350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 360/730] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:34.617948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.638002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.638633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.638907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.639166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.641379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:34.663071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:34.665821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:34.700665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:34.701918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:34.703011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:34.703011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:34.703011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:34.707030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 371/731] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:34.713983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.779352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf8392-fd6c-4d30-bf2e-40cfa8a27689 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.814705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.815693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.816161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.816614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.823894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bcb3-13fd-4ac6-915e-f43a8ad63a05 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.828349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:34.830054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-78e40be5-60fe-439e-8983-df4c7a7e04bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:34.847282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:34.848248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:34.849293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:34.849293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:34.849293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:34.851438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 361/732] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:34.852871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ec976-3418-4cfa-af15-c6ffc488976d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.853379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ec976-3418-4cfa-af15-c6ffc488976d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.853811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ec976-3418-4cfa-af15-c6ffc488976d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.855413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 362/733] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:34.856871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ec976-3418-4cfa-af15-c6ffc488976d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:34.861747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:34.862357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.862632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.862899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.863546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:34.863842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:34.865241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f56b2-8ea1-4052-9d3d-67057279cce3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:34.877942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 372/734] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:34.882985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:34.882985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:34.882985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:34.898122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:34.899497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:34.919657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:34.939909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:34.977162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 373/735] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:34.978107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ec976-3418-4cfa-af15-c6ffc488976d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:34.979250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.029950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.030919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.031470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.031901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.032710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:35.033194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.034776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.050779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 363/736] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:35.052084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.091122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7d9f7-798d-420f-8644-acc609887d63 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.138654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.139339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.139620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.139883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.147589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.149080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.156644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d59e87-576f-47d5-ab45-2d7b51a4c1b3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:35.160856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:35.161814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 374/737] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:35.163421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.184673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.186516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.202355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719e16-ea95-468f-ad14-77eb72daa26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.203005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719e16-ea95-468f-ad14-77eb72daa26f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.203281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719e16-ea95-468f-ad14-77eb72daa26f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.203550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719e16-ea95-468f-ad14-77eb72daa26f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.215528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719e16-ea95-468f-ad14-77eb72daa26f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d3719e16-ea95-468f-ad14-77eb72daa26f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:35.220365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:35.221340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:35.222227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 364/738] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:35.222921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1a34-6c46-4972-bd71-26124dd814f9 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.223754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1a34-6c46-4972-bd71-26124dd814f9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.223754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1a34-6c46-4972-bd71-26124dd814f9 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.224646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 365/739] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:35.229871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d1a34-6c46-4972-bd71-26124dd814f9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.279117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160abaa-0654-46b2-8d3f-c08109d718e9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.313257 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.313923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.314158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.314421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.322411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.323857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:35.334925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:35.335866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:35.336874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 375/740] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:35.337508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.356173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d1a34-6c46-4972-bd71-26124dd814f9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.396902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.397495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.397769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.398032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.398787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:35.399086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.400512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.418658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.445022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295476f9-0000-4577-bcd8-f263e00a252c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.482270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.482886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.483162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.483423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.484087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:35.484384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.485807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca331056-0f94-4c94-a725-903692cb5030 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.499792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 376/741] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:35.499792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.499792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.499792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.518102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:35.519392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:35.545127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 366/742] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:35.545127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.590211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.596509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 377/743] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 10:58:35.597270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.670202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.671221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ff88a-00a8-46c0-b225-621fa0be89f5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.704039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc1aac-9e45-4db3-8447-54fdddcd44c9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.706480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.707189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.707535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.707889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.708710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:35.709136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.710740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.730624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 367/744] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:35.731685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.745443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.746073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.746346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.746608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.757238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.758690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:35.774175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:35.775365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:35.776674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:35.776674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:35.776674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:35.777389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 378/745] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:35.778252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.836140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.839402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b603b-92d9-4cd9-895c-be2416d9a19a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.874751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.875526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.875876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.876204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.882601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a290b-abd3-4a9c-90fc-7ee6a87725ff None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:35.887854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.889378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.903763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:35.903909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:35.905018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:35.910735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:35.910735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:35.910735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:35.910735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 368/746] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:35.910735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:35.926777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:35.927297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:35.927931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:35.928244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:35.928894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:35.930298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:35.949367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 379/747] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:58:35 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:35.950145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.051877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b00f5-d00f-4bf8-b611-6a53a91a7a9c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.090344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d45d8-5681-4760-b82b-b0941764b38d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.091785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8b081-17ae-4bcb-ab45-ffb21db644cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.092526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8b081-17ae-4bcb-ab45-ffb21db644cd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.092902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8b081-17ae-4bcb-ab45-ffb21db644cd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.093297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8b081-17ae-4bcb-ab45-ffb21db644cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.121331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.132940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.133852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.134129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.134396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.135040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:36.135335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.136710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.151998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 380/748] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:36.153949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.169078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8b081-17ae-4bcb-ab45-ffb21db644cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.170536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8b081-17ae-4bcb-ab45-ffb21db644cd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.193535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.266181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441562de-13de-4355-bca4-5e59d3d72337 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.283046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 369/749] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:58:36.283046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abff5-b7ba-4d00-b64b-616c7912c98a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.283046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abff5-b7ba-4d00-b64b-616c7912c98a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.283046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abff5-b7ba-4d00-b64b-616c7912c98a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.283046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 370/750] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:36.283046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abff5-b7ba-4d00-b64b-616c7912c98a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.307702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.308361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.308629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.308857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.309510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:36.309807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.311172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.327456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 381/751] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:36.327456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.343456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.394492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abff5-b7ba-4d00-b64b-616c7912c98a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.428397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.434314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.434865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f452-ad82-402b-a021-146e84c1b49a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.435385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.435831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.436280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.443956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.445460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e2aac709-4767-419e-8050-f65a7a6d4954 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:36.457281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:36.458398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 371/752] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.464237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.465123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.477416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.478120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.478460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.478788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.480287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:36.481603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:36.489884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.491474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:36.506301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:36.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:36.513726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:36.513726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:36.513726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:36.513726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 382/753] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:36.513726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.561019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 372/754] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:36.561019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.611747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.621757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055a39c-45fd-4509-a202-c4de67d2b616 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.656834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.657586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.657926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.658268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.665230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.666756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.670800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22d686-916a-4bd4-b299-49d989dc4585 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:36.677666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:36.678667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:36.679562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:36.681092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 383/755] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:36.682130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.696238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.711719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.712325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.712594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.712851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.713606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:36.713888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.715291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.733554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 373/756] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:36.734385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.795594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdbb5-25d1-4f30-b2a4-a3119e388fa0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.828645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.829267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.829558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.829804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.830450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:36.830742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.832118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.837236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.840919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1358e3-17e2-440f-84d9-65ee597a8cca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.845145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 384/757] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:36.846101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.877411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.878042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.878313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.878581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.879160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.880877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:36.891278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:36.892287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:36.893173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:36.897252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 374/758] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:36.898248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:36.921069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:36.955402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096270a-8045-4d46-9b3e-b31e609e8dc3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:36.994031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:36.994641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:36.994914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:36.995181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:36.995863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:36.996163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:36.997635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.005689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833679f5-5703-4fc0-9bfd-590f329928e8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.009693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 385/759] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:37.010502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.043177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.044035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.044349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.044579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.078745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.117453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.119194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.122922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3937dff-739d-4724-8898-d5442eda9d03 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.155976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.164802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.165464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.165739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.166115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.173050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.174487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:37.185829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:37.186729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 386/760] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:37.192591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.227746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 375/761] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:58:37.233059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.295598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.296013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80f08-ab00-4c15-bf97-f186194c399f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.331058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.331680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.331908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.332167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.332777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:37.333107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.334251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36386e-84c4-4d04-8c76-415a2e38b627 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.334518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.339166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 387/762] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:37.339764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.377224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.378384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.378758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.379129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/ded8e23edf404c378eba94e917be0c8e/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.381678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=ded8e23edf404c378eba94e917be0c8e, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.383301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.391610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.409020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 376/763] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:37 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/ded8e23edf404c378eba94e917be0c8e/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:37.409020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.455831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75781f-12d9-45b1-9067-a6ca10b2f393 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.503438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.504067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.504616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.507846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.508612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:37.509001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.510532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.529882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 388/764] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:37.529882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.567727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf5c6e-7421-41be-874e-ac12c8613597 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.602656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.623736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.625126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.625804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.626239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.642009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.643598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c667f8-e141-4544-9ddf-c712a649d527 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.643861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.658235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:37.664952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:37.666103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:37.667202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:37.667202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:37.667202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:37.670103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 377/765] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:37.671099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.687810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.688422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.688767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.689135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.689838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:37.690254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.691788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.702493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 389/766] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:37.703495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.803047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186bfc-bff4-439b-82a1-a95ed5e3b522 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.824656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828812e-20cf-4ed5-b087-5d1752c297b0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:37.839244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.839994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.840380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.840835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.841714 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=8553125282aa414db923858f1e27c76f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:37.842279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.843731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.857225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 378/767] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/role_assignments?user.id=8553125282aa414db923858f1e27c76f&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:37.857225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.891749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:37.892555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:37.892928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:37.893316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:37.894098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:37.894499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:37.897930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:37.930866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 390/768] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:37.942653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:37.944156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:37.984243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:38.012052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f91ead-f1d3-487e-a01d-015cfd72b445 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.052915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.053798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.054012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.054275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.054976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] RBAC: Adding query filter params (interface=public, service_id=a784cd1e18b249388a5abe88f7e1cfe0, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:38.055279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.056643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8af0b-5cd1-4d7a-ab9d-f17ad1a22ba1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.069174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 379/769] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/endpoints?service_id=a784cd1e18b249388a5abe88f7e1cfe0&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:38.070501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3794f-d186-4d5e-a226-227d969eb14e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.070783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3794f-d186-4d5e-a226-227d969eb14e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.071052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3794f-d186-4d5e-a226-227d969eb14e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.071274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9553fcf-f0aa-42e2-a97d-9b7e4d097aca None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.072915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 380/770] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:38.078301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.078571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.078835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.097016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:38.098230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:38.115789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.116788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.117097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.117361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.129013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.129013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:38.141764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:38.142873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:38.143950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:38.149007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 391/771] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:38.149334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:38.189242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 381/772] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:38.190309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:38.240399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:38.252960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:38.261659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5e20e-e04b-4be5-b807-a9bb90f419da None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.309046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.310191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.310867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.311291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.312035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.312683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765b21-0b41-41bd-a73a-9fc1683d2ddf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.313728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.325331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 392/773] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:38.328013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:38.397949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.398587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.398865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.399126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.399834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:38.400136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.401643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.428778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 382/774] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:38.442098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:38.449569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfab26-7ba6-418d-b914-9f45fb1a2175 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.494296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.496306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.497848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.498310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] PATH_INFO: `/v3/services/network` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.500839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.502529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:38.523613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:38.524688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:38.525584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:38.528663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 393/775] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:38.534615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:38.564828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:38.619681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:38.628034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb255605-1a83-4141-91c4-7ba09ab08555 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.650208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac87f95-56b8-463d-bc1a-8f234fd78a4d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.672969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.673838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.674348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.674749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.675796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:38.676277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.677960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.689272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 383/776] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/role_assignments?user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:38.690544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.691291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.691664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.692027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.692771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] RBAC: Adding query filter params (name=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:38.693210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.694842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.700919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 394/777] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:38.710574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:38.848275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c85d2c-01e2-41a7-821f-bb80d6ba7e35 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:38.887634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:38.888533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:38.888947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:38.889420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:38.890186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] RBAC: Adding query filter params (type=network) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:38.890619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:38.892138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:38.898952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 384/778] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:38.904896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:39.028452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:39.042133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd243b6c-6cdb-4c05-a65f-a2f2b276c387 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:39.091218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:39.091885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:39.092161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:39.092429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:39.093375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] RBAC: Adding query filter params (interface=public, service_id=42463366cd4446d09f954f5943e8e5e0, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:39.093777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:39.095311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ef920-471b-4a17-8bc2-1d316c1d793e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:39.104643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 395/779] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:58:38 2022] GET /identity/v3/endpoints?service_id=42463366cd4446d09f954f5943e8e5e0&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:39.110006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:39.153412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:39.255646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926eb3-b580-4d77-96c9-4763218a27cc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:39.289430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed45d1-4bb7-4884-87d2-b351341f5b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:39.290045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed45d1-4bb7-4884-87d2-b351341f5b6c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:39.290323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed45d1-4bb7-4884-87d2-b351341f5b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:39.290591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed45d1-4bb7-4884-87d2-b351341f5b6c None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:39.291201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed45d1-4bb7-4884-87d2-b351341f5b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:39.292566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed45d1-4bb7-4884-87d2-b351341f5b6c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:39.298073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 385/780] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:58:39 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:39.624049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5598-54b2-4ca8-97b0-8e080289d3ed None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:39.624583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5598-54b2-4ca8-97b0-8e080289d3ed None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:39.624583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5598-54b2-4ca8-97b0-8e080289d3ed None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:39.626224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 396/781] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:39.635093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:39.635903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:39.636363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:39.656678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:39.658216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:39.741660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 386/782] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:39.765068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5598-54b2-4ca8-97b0-8e080289d3ed None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:39.896959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5598-54b2-4ca8-97b0-8e080289d3ed None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:39.946578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:39.947200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:39.947468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:39.947725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:39.964052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:39.968746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:39.969667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:39.970494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 397/783] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:39.976240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:40.001009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:40.086678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade8d1-6a97-4ebd-a9af-869f952d2705 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:40.120783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:40.121749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.122211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.122682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.123526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:40.124036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:40.125690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:40.135701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 387/784] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:40.142388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:40.170034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:40.256756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78824c-0be1-45b4-83dc-6353274440b7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:40.290405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:40.291330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.291801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.292246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.304239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:40.305936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9abb75bb-e27c-4287-ba84-ac4a57fece12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:40.320285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:40.321305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:40.322191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:40.322191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:40.322191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:40.324030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 398/785] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:40.329581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:40.410419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d9e7-9098-4518-8cd3-440fca32bf23 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.411070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d9e7-9098-4518-8cd3-440fca32bf23 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.411651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d9e7-9098-4518-8cd3-440fca32bf23 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.413506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 399/786] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:40.430395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1664c-a746-408f-8b27-aadce434007d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.430959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1664c-a746-408f-8b27-aadce434007d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.431429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1664c-a746-408f-8b27-aadce434007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.441732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:40.473460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-39a1664c-a746-408f-8b27-aadce434007d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:40.477582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-39a1664c-a746-408f-8b27-aadce434007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:40.485195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61980a44-ffe1-4c68-b9d4-1b6b92bd6ef7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:40.537971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:40.539016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.539505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.539956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.540848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:40.541357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:40.542900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:40.555560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 388/787] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:40.561563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:40.598899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:40.617082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 400/788] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:40.650118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1664c-a746-408f-8b27-aadce434007d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:40.702915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3661-6db5-42d3-99af-645e646c034e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:40.748745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:40.749798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.750351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.750828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.766701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:40.768548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:40.770884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:40.783653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:40.784727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:58:40.785746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:40.788370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 389/789] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:58:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:40.793993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:40.810989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1664c-a746-408f-8b27-aadce434007d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:40.844895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56c47e-dca6-4075-b11e-578fbc3d89f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:40.845585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56c47e-dca6-4075-b11e-578fbc3d89f1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.845862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56c47e-dca6-4075-b11e-578fbc3d89f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.846130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56c47e-dca6-4075-b11e-578fbc3d89f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.861880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56c47e-dca6-4075-b11e-578fbc3d89f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fe56c47e-dca6-4075-b11e-578fbc3d89f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:40.868378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:40.869337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:40.870164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 401/790] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:40.871366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30da23-4dd1-4a0e-a7f5-9eac279ced84 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.871463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30da23-4dd1-4a0e-a7f5-9eac279ced84 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.871662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30da23-4dd1-4a0e-a7f5-9eac279ced84 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.876568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 402/791] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:40.879439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.879439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.880086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.903042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:40.904762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:40.939400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3321aee-ad04-436d-afa5-5e1bb5efc0bb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:40.970148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:40.977259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:40.977877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:40.978147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:40.978407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:40.979230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:40.979559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:40.981084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:40.993252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 403/792] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:40.994300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.014537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 390/793] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:58:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:41.020015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.099215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.115289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2817b-07f3-4385-8e05-7da1340c06fe None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.148350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c3f32-9c8a-4dbb-a04c-265dad8af773 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.151077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.151851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.152272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.152683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.153537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:41.153979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.155487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.165333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 404/794] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:41.166439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.184571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.185382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.185493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.185756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.214472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.255266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.256694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.271124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372200a-708e-4ee6-878a-aeed09d4da5f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.305903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.306627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.306902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.307165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.307848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.309241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.313743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-49461e14-e19c-4829-a7ac-0d77b7303879 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:41.318982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:41.319992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:41.320841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 405/795] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:41.322116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e94c5-6564-480a-bdac-f33398b22df7 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.322116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e94c5-6564-480a-bdac-f33398b22df7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.322116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e94c5-6564-480a-bdac-f33398b22df7 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.327005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 406/796] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:41.327785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e94c5-6564-480a-bdac-f33398b22df7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.369799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 391/797] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 10:58:41.370742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.443975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e94c5-6564-480a-bdac-f33398b22df7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.454575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.479037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303230c4-5957-4606-a76f-9dcd4f490bac None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.480463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.481116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.481393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.481657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.492848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.494515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fbef6cd6-9e16-45ec-818f-fe2afc359797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:41.509958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:41.510886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:41.511790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:41.511790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:41.511790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:41.511790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 407/798] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:41.512601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.512762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.513008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.519402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.520012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.520286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.520540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.521189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:41.521491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.522912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.532214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 392/799] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:41.532214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.533424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:41.534771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:41.553063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.606955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 408/800] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:41.608023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.643356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89648f0f-32ae-4e22-8782-71d09f34e504 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.679934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.680558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.680830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.681122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.691385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.692995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:41.707723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:41.709391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:41.710380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:41.710380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:41.710380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:41.710380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 393/801] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:41.710753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.719047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.729266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b79b-2083-4a8a-bf19-20a4dc0bf3d4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.770201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.770723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.770994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.771255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.772101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:41.772398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.773901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.785142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.791644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 409/802] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:41.791644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.818094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee18b2-c699-41c3-a07e-4e5caad21406 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.850748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.851346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.851618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.851886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.852514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:41.852816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.854218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.859054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 394/803] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:41.859748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.893479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317768b7-e7c6-4682-9e1b-927bdc179b03 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.925421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.926040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.926308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.926567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.936428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:41.942051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:41.948176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 410/804] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:41.949282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:41.957700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f104e47-a671-4c89-828a-79aa72b31559 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:41.958305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:41.991369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:41.991970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:41.992244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:41.992510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:41.993189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:41.993483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:41.994841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f5c5e-debf-4ddc-9391-43850cb43c29 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:41.997098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.007982 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 395/805] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:42.009171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c45cf-f694-455a-ae4a-89ec07e66b2e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.009449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c45cf-f694-455a-ae4a-89ec07e66b2e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.009713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c45cf-f694-455a-ae4a-89ec07e66b2e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.011030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 396/806] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:42.011548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c45cf-f694-455a-ae4a-89ec07e66b2e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.047424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1028f7-4211-415a-ae44-42b60d5bbdea None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.080590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.081239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.081524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.081781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.090068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.091668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:42.103866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:42.104928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 411/807] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:42.106022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.117185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c45cf-f694-455a-ae4a-89ec07e66b2e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.154401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.155004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.155278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.155542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.156194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.157590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.176787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.193013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 397/808] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:58:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:42.193013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.209442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0adb7-7bb6-43e4-8a28-7b5729ad659d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.238889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.255751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.256413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.256684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.256940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.257631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:42.257920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.259302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c065-805a-4bc8-8513-6026872b8aec None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.273234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 412/809] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:42.273234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.273234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.273234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.289607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:42.290820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:42.299651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b679b-6eff-4fe4-9ca2-cee5d336ab21 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.335525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.336164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.336472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.336717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.345231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.346678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:42.358774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:42.359712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:42.360634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 398/810] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:42.361725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.373098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 413/811] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:42.373098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.440063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.483073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1620ea-d481-456a-a944-f6b15a884e9c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.487965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a557-b540-45ef-9ffd-93ed5b075019 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.501771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.522462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.523097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.523370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.523636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.525343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.525953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.526231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.526504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.527241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:42.527543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.529013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.535216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.536660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.551674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 399/812] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:42.551674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:42.551909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:42.552791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:42.554825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:42.554825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:42.554825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:42.554825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 414/813] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:42.554825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.661294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899484-4f4a-4472-a20d-395fcf8f4852 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.661644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a83f16-deed-46f2-ad59-c37d803b203a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.678655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.698518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.699132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.699761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.700040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.700756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:42.701097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.702530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.705012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.705653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.705928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.706190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] PATH_INFO: `/v3/services/network` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.706765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.708115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.719063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 400/814] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:42.719063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:42.719671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:42.720819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:42.723121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 415/815] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:42.723957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.761330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.823657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58eda3-dc44-4659-aaf8-32c55482028a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.835890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931ead-881d-4726-8727-82b03ed2abbe None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.857537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.858160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.858438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.858696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.859326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:42.859619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.860992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.869675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:42.870315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:42.870588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:42.870852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:42.878524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 416/816] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:42.878524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.884200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:42.885674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:42.900464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:42.901468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:42.902357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:42.902357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:42.902357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:42.902357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 401/817] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:42.902593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:42.921149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:42.988806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d6a67-e13b-4150-b073-82fa948aaa58 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:42.993917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.016091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca31f14-7f82-4d78-a030-b683f64fb2b3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.024906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.025527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.025796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.026058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.026763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=ded8e23edf404c378eba94e917be0c8e) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:43.027062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.028479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.037119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 417/818] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/role_assignments?user.id=ded8e23edf404c378eba94e917be0c8e&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:43.037975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.063522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.064152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.064418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.064680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.065369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] RBAC: Adding query filter params (name=network) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:43.065667 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.067082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.077038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 402/819] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:43.077038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.195571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.200962 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd17ab-67e9-4861-a704-30e7b4d59abf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.212674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcaf21-bcda-42c8-9338-3385a0f2f00c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.247907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.248536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.248806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.249351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.258200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.258339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.258339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.258517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.258586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.258655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.259261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:43.259560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.262500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:43.271766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:43.272892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:43.273907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:43.274436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 418/820] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:43.274930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.279952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 403/821] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:43.280676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.289578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.390557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86c65-c93e-4221-99b3-9b4fe855b6b2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.412859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e28d5-1435-4378-9b22-ff3007157d2f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.429875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.430990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.431268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.431809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.441462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.443552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.450886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.451531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.451802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.452063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.452683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:43.452994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.454416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:43.456278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:43.457198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:43.458737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 404/822] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:43.459550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.464730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 419/823] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:43.465759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.506252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.536198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.578799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efcb01-67c3-4c1f-9f75-cb78b2f9d156 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.598751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e0a1-fb01-44e3-a3c1-1d64a63d4ee4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.626027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.627142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.627597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.628259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.630214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:43.630678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.632337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.634314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.634990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.635325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.635705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.636560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:43.636800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.638381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.654322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 405/825] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:43.655467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.656533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 420/825] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:43.658035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.763094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.772806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8765b7-9b16-44d5-861b-4bbc355b8e4e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.782358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d24a-f9c8-4b38-b117-1809c087e10c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:43.797687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:43.810393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.811156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.811522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.811877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.812623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.814127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.822840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:43.823796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:43.824305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:43.824768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/8553125282aa414db923858f1e27c76f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:43.827930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=8553125282aa414db923858f1e27c76f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:43.829727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:43.837978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 406/826] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:58:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:43.839228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:43.865024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 421/827] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:43 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/8553125282aa414db923858f1e27c76f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:44.017694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c025bae-0aa2-4aba-90a7-bc2b53111969 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.060704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.061859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.062340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.062794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.075216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.077133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-de57c802-71dc-4cfd-a235-9e7056795683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:44.093111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:44.094115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:44.094997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:44.094997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:44.094997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:44.097521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 407/828] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:44.104106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.211866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a25f-ba18-4741-a0e7-19763be6ac32 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.236776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1612e7-c952-4104-96f8-76c5210be841 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.237083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1612e7-c952-4104-96f8-76c5210be841 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.237351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1612e7-c952-4104-96f8-76c5210be841 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.238702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 408/829] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:44.244027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.244301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.244565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.256642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.257539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.257815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.258088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.258745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:44.259044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.260444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.275673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 422/830] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:44.277707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:44.279027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:44.281039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.286076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:44.309351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:44.368288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 409/831] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:44.390116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.398130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be1b44-ea7e-4a5f-82c5-c338d5e905c4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.432392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.433054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.433333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.433603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.440781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.442272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:44.453782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:44.454751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:44.456299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 423/832] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:44.461982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.504229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508e931-307a-48b0-9c42-d324c9960815 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.540335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.540521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:44.541452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.541946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.542398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.543229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.544754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:44.554712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:44.555753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:44.556596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:44.564073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 410/833] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:44.565642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.587245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5aabb-6ab9-4f69-a3ff-5be700820ee8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.597368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:44.632073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.632921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.633243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.633511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.634209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:44.634508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.635947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.653125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 424/834] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:44.657970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.685949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8360c-8bb1-4431-bf91-252cda3d02d6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.723072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.723913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.724387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.724877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.726153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:44.726662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.728227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.738816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 411/835] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:44.740424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:44.773202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43968c4-421d-4d78-90e0-9fe05ca7fb35 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.799277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:44.812159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02924efb-d208-4059-8fcd-9b32600a1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.813208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02924efb-d208-4059-8fcd-9b32600a1f6c None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.813813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02924efb-d208-4059-8fcd-9b32600a1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.814319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02924efb-d208-4059-8fcd-9b32600a1f6c None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/55bc1cb8ee2a4dd3a47961c8189d2ec5/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.834709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02924efb-d208-4059-8fcd-9b32600a1f6c None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=55bc1cb8ee2a4dd3a47961c8189d2ec5, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.836542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02924efb-d208-4059-8fcd-9b32600a1f6c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.850410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:44.855681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 425/836] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:44 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/55bc1cb8ee2a4dd3a47961c8189d2ec5/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:58:44.871373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446ead7-7caa-4063-a95f-6c075d275269 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:44.910958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:44.911894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:44.912304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:44.912831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:44.913795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:44.914233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:44.915774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90085-2522-4fe1-8cfb-ce77168bf8c4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:44.926802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 412/837] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:45.206559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abbb73-4304-4b13-94aa-4a261158bbdc None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:45.207140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abbb73-4304-4b13-94aa-4a261158bbdc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:45.207543 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abbb73-4304-4b13-94aa-4a261158bbdc None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:45.209350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 426/838] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:45.215239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:45.215827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:45.216319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:45.235517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:45.237081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:45.313078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 413/839] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:45.331587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abbb73-4304-4b13-94aa-4a261158bbdc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:45.435142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abbb73-4304-4b13-94aa-4a261158bbdc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:45.469442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:45.470414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:45.470877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:45.471345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:45.472106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:45.473671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:45.482577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:45.483482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:45.484370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:45.491396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 427/840] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 10 10:58:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:45.492901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:45.573153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:45.592178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f308fbb-42f7-4aa9-891c-f2ce8d9141ef None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:45.628180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:45.629102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:45.629371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:45.630006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:45.630633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:45.630923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:45.632373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ee5da-981a-43cb-af61-447c9d4c7c2d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:45.641101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 414/841] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:45.643231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:45.683903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:45.744501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318f843-611a-4b18-8a77-203ddfb887c9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:45.779320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:45.779931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:45.780178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:45.780436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:45.781086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:45.781380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:45.782735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49969beb-a198-40ab-b0b3-ab928a47f535 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:45.793160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 428/842] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:46.178846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01c52-869a-4ff9-884b-dfae2382d7f3 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.179401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01c52-869a-4ff9-884b-dfae2382d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.179401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01c52-869a-4ff9-884b-dfae2382d7f3 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.180955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 415/843] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:46.186150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.186431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.186699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.204615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:46.205827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:46.274233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 429/844] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:46.296147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01c52-869a-4ff9-884b-dfae2382d7f3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:46.395867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01c52-869a-4ff9-884b-dfae2382d7f3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:46.429315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:46.429943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.430214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.430476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.440609 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:46.445480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:46.446416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:46.447259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 416/845] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:46.452929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:46.485288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:46.555536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2043c-7da1-47d3-b6a3-d30a0d8eb73c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:46.590564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:46.591185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.591450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.591714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.592376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:46.592673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:46.594098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:46.603126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 430/846] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:46.608779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:46.613309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:46.720864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8042-6f95-4234-8b89-2a40a3d0f9a0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:46.756658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:46.757311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.757578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.757834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.768156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:46.769641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:46.784306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:46.785278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:46.786155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:46.786155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:46.786155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:46.786155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 417/847] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:46.791186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:46.887531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:46.894379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a16a0-7955-4dbe-af51-7725c12ec2f7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:46.929423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:46.930119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.930395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.930711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.931476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:46.931837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:46.933248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68cce-a9bf-4a82-9a8e-1b5c42ebc422 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:46.947001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 431/848] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:46.952635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:46.966911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3953d-b529-47f5-80b9-d759e668fcf2 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.967481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3953d-b529-47f5-80b9-d759e668fcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.967952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3953d-b529-47f5-80b9-d759e668fcf2 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.969755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 432/849] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:46.975106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5f05-2e03-4fbd-9760-7f74270d8069 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:46.975576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5f05-2e03-4fbd-9760-7f74270d8069 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:46.975843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5f05-2e03-4fbd-9760-7f74270d8069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:46.995140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d99c5f05-2e03-4fbd-9760-7f74270d8069 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:46.996385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d99c5f05-2e03-4fbd-9760-7f74270d8069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:47.021328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.070434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c145eb-1757-447a-89ad-8fb32d620427 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.070628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 433/850] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:47.071813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062c33e-ed5d-4722-a4e5-9f17ebae8c59 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.072096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062c33e-ed5d-4722-a4e5-9f17ebae8c59 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.072363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062c33e-ed5d-4722-a4e5-9f17ebae8c59 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.073645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 434/851] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:47.078895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.079455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.080034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.098625 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:47.099795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:47.107723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.108346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.108613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.108876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.117880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.119313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:47.135127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:47.136060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 418/852] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:58:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:47.137125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.176184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 435/853] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:47.176930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.191742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.258920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d24cc-d87c-43ec-b8bc-3d442a738345 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.275446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.281216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0240a-73fd-4821-83cc-8538d7f7f6c3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.296303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.297145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.297532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.297804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.310243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:47.315603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:47.316728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 419/854] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:47.323021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.324329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.325083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.325442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.325772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.326571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:47.326935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.328433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.351121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 436/855] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:47.351121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.423494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.428342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca705-c7c1-4688-8cc5-143f8c41fc05 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.454987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230bb93-e09f-45c7-b7d9-50d60cbc53c7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.463372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.463977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.464249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.464521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.465206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.466566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.482613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 420/856] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:58:47 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:47.483654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.513508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.514282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.514647 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.515037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.516158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:47.517131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.518979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.530910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.533829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 437/857] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:47.539224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.615069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8082-cf1b-4019-b4de-23eaab6129fc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.661266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.661881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.662317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.662625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.682392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbbbd-fe11-4457-8b44-273a00df42d4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.712503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.722409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.723403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.724026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.724481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.736800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.738857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.748064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.749926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:47.755231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:47.756352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:47.757475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:47.757475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:47.757475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:47.759168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 438/858] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:47.764906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.789598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:47.861948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 421/859] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:58:47.863205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.873870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0aa2a-a1b2-4207-82cb-e994e2bddf16 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.910902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:47.911753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.912264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.912598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.913283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:47.913618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:47.914986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f82bee-de12-4877-803d-52475a00bacb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:47.927052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 439/860] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:47.932684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ce4f9-e0ba-4b8f-9a23-13821967b146 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:47.932968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ce4f9-e0ba-4b8f-9a23-13821967b146 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:47.933272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ce4f9-e0ba-4b8f-9a23-13821967b146 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:47.934786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 440/861] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:47.935357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ce4f9-e0ba-4b8f-9a23-13821967b146 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:47.971576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2fc96-6549-4b21-b91e-16c734bead79 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:47.981830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.012224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.012852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.013160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.013425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.016461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.025737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.027234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-39b84506-04a4-493a-8e64-ac1701053db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:48.041919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:48.042895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:48.043770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:48.043770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:48.043770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:48.043770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 422/862] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:48.044514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.044514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.044744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.048966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ce4f9-e0ba-4b8f-9a23-13821967b146 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.062188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:48.063378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:48.088667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.089332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.089603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.089868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.097570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.099015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:48.110581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:48.111697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 441/863] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:58:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:48.112638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.153131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 423/864] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:48.153131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.216518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78a60-df5f-44c7-8058-9d3024da5810 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.218600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.254300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.255294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.255566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.255831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.256499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:48.256798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.258213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.264764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97116e30-070a-4f1e-ad96-7052cd93f64c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.275631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 442/865] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:48.275631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.283845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.303529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.304102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.304373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.304637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.305400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:48.305701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.307131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.326730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 424/866] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:48.327453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.382839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21068e-7e15-47a2-b8fa-96ab1db81dce None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.415890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.416491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.416765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.417056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.417713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.419085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.435487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 443/867] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:58:48 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:48.435977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f52e5-309f-4a3c-b8be-46dd2f80195a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.436737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.473233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.498643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.499438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.499773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.500159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.511194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.513317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:48.530457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:48.531432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:48.532349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 425/868] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:48.537618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.582379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.582671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a8a44-81e4-4866-a04d-84ea331b6e1f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.626183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.627451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.627451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.627451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.680746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806cda-2f05-44b1-a854-279371abc35b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.708742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.710289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.726296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.727528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.728035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.728729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.730045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:48.730552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.732722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.735423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.752450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 426/869] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:48.762180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.816825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 444/870] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:58:48.822326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:48.860093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.870989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283dad-d8c1-4877-b627-bf6d15acd114 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.907794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.908396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.908672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.909059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.909942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=8553125282aa414db923858f1e27c76f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:48.910249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.911682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.924237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 427/871] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/role_assignments?user.id=8553125282aa414db923858f1e27c76f&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:48.924742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e835a1-42dc-45b5-af3c-27f1d24d982f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:48.951686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:48.964761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:48.965497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:48.965780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:48.966044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:48.978031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:48.979604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:48.996100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:48.997145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:48.998019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:48.998019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:48.998019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:48.998019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 445/872] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:49.005075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:49.112549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea25c-8df2-4990-9bc7-d954b0a2ec3e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:49.150899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:49.151511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.151789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.152053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.152690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:49.153012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:49.154400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:49.167568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 428/873] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:49.173231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:49.280863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57c65b-16d2-4c15-967f-6ec9971bad5f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:49.314956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:49.315586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.315861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.316126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.323068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:49.324520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:49.335854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:49.336766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:49.337711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 446/874] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:49.343199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:49.362638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:49.449891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c2e7-6635-4a83-bf75-0a5f0f63bddb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:49.489083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:49.489690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.489955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.490214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.490947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:49.491240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:49.492654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e16b1-da61-4074-8d31-fb6d99165cd3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:49.505156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 429/875] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:49.511151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:49.561354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:49.578050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54fde2-d90b-421e-b93c-a341085415ff None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.578403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54fde2-d90b-421e-b93c-a341085415ff None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.578597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54fde2-d90b-421e-b93c-a341085415ff None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.583717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 430/876] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:49.585257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.585535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.585809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.605260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:49.606426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:49.617832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d895-1ab7-422f-8b3c-5e307aeec5f0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:49.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:49.658054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.658335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.658731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.659551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:49.659910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:49.661382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:49.668360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 447/877] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:49 2022] GET /identity/v3/role_assignments?user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:49.685179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 431/878] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:49.699654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:49.813391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:49.817052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976765-bc56-43b8-89b9-6796313f7de7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:49.852455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:49.853130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:49.853403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:49.853666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:49.854245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:49.855618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:49.864271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:49.865258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:49.866545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 448/879] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:49.872500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:49.881284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:49.978109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71659ad-fad4-4bb5-9471-3293a12ef74f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:50.011781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:50.012383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.012650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.012909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.013578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:50.013867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:50.015225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:50.020336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 432/880] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:50.026113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:50.127424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ceb3-304e-4d1d-8f8e-ef263327b60c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:50.161763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:50.162429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.162703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.162971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.163645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:50.163944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:50.165435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:50.170861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 449/881] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:50.176309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:50.250665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:50.282473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da247ce-bbe5-442c-bd25-1c3ea45b22a8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:50.316174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:50.316775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.317074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.317340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.318027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] RBAC: Adding query filter params (interface=public, service_id=67f4796167b34731822d018290d72c3e, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:50.318333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:50.319747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0adced-537b-4e09-b30c-25c1823eac9c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:50.325180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 433/882] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:58:50 2022] GET /identity/v3/endpoints?service_id=67f4796167b34731822d018290d72c3e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:50.330680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:50.358657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:50.436793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953ccce-dc59-49cb-b379-631e1b74aaed None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:50.470406 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348dddc-104a-4760-9c92-fa998eb45135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:50.471022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348dddc-104a-4760-9c92-fa998eb45135 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.471290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348dddc-104a-4760-9c92-fa998eb45135 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.471553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348dddc-104a-4760-9c92-fa998eb45135 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.472152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348dddc-104a-4760-9c92-fa998eb45135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:50.473563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348dddc-104a-4760-9c92-fa998eb45135 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:50.479750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 450/883] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:58:50 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:58:50.584421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf2ff6-c7f5-4508-a733-8fda75f66a19 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.584421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf2ff6-c7f5-4508-a733-8fda75f66a19 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.584421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf2ff6-c7f5-4508-a733-8fda75f66a19 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.585622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 434/884] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:50.591434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.591727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.591966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.611315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:50.612533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:50.686329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 451/885] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:50.708586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf2ff6-c7f5-4508-a733-8fda75f66a19 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:50.811114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf2ff6-c7f5-4508-a733-8fda75f66a19 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:50.851050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:50.851692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:50.851964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:50.852229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:50.852817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:50.854203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:50.863110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:50.864055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 435/886] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 10 10:58:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:50.865496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:50.873141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:50.898368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:50.979396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bdf60-36a4-422c-ab19-268dc1377933 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.014105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.015108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.015576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.016055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.016890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:51.017424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.019022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5db51d-c543-4531-863e-6181b6d49c9a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.029081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 452/887] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:51.031563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.136736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea672-0049-4353-b1f2-9423515d71e3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.146508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc54a8c-7235-473e-9402-ef8e0b3a932f None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.147173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc54a8c-7235-473e-9402-ef8e0b3a932f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.147629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc54a8c-7235-473e-9402-ef8e0b3a932f None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.150445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 453/888] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:51.154570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806601-adfc-49f0-b9f2-640598181901 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.155049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806601-adfc-49f0-b9f2-640598181901 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.155506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806601-adfc-49f0-b9f2-640598181901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.172378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.173005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.173293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.173564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.174198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:51.174496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.174842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-40806601-adfc-49f0-b9f2-640598181901 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:51.175860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.176390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-40806601-adfc-49f0-b9f2-640598181901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:51.185015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 436/889] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:51.187022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.248248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:51.258368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 454/890] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:51.283462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40806601-adfc-49f0-b9f2-640598181901 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.294765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3f17-025f-4127-8220-e53010c91caa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.302734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:51.330420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.331530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.331994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.332449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.333370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] RBAC: Adding query filter params (interface=public, service_id=8ff982f7e6d04ec79b8e2d5979b55d76, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:51.333881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.335511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.343794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 437/891] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/endpoints?service_id=8ff982f7e6d04ec79b8e2d5979b55d76&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:51.349443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.415084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40806601-adfc-49f0-b9f2-640598181901 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.450329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.451359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.451863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.452312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.453125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.454681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:51.463705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:51.464687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:51.465538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:51.466270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df09c-0eee-4a1e-b9c9-774c31d1a88e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.473040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 455/892] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:51.474639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.491641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:51.502375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.502919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.503203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.503454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.504063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.505908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.517093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 438/893] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:58:51.562937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:51.586805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4510-84f2-4411-bff1-885c51edee6a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.623948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.624563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.624830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.625136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.625764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:51.626054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.627441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9e11-8221-47f7-9a90-21b360bae364 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.638253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 456/894] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:51.642440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.754882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2378-8687-413d-9df2-bf899107d535 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:51.789994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:51.791012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.791130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d343f-470a-4fa3-84dd-18c64b91db51 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.791371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d343f-470a-4fa3-84dd-18c64b91db51 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.791638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d343f-470a-4fa3-84dd-18c64b91db51 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.792013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.792472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.793345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:51.793855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:51.795411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:51.796923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 457/895] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:51.798113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:51.798397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:51.798664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:51.801692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 439/896] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:51.817799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:51.819320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:51.892012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 458/897] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:51.915606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:51.980207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:52.027286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34c8c-3065-419c-82ee-1ea1c9a8d198 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.062166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.062796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.063071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.063327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.074271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:52.079457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:52.080398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:52.081256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 440/898] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 10 10:58:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:52.086855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.161361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:52.191514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29fd1e-a7d1-4d78-a041-a66215f43ae1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.225824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.226521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.226796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.227059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.227711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:52.228005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:52.229401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:52.238296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 459/899] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:52.243887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.354414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01713-a8ad-4e61-a67d-fe699b223cca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.369017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:52.392014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.393075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.393554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.394017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.405249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:52.406962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:52.421474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:52.422430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:52.423334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:52.423334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:52.423334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:52.425108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 441/900] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:52.431487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.536254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea06b4-529b-4bca-b6c5-296b643ace5c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.570240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.570888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.571120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.571383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.572020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:52.572314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:52.573698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af3846-6b9d-4f93-8ed0-cf67ee2879a8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:52.575143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:52.586118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 460/901] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:52.591835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.628217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91622-c6f9-4c45-8949-ba70c791c667 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.628393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91622-c6f9-4c45-8949-ba70c791c667 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.628662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91622-c6f9-4c45-8949-ba70c791c667 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.630658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 461/902] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:52.635626 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.635922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.636169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.654830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:52.656009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:52.702952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ab95-7094-4d37-8f6a-580f7734547a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.728599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 462/903] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:52.746419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.747057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.747403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.747671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.752364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.757422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:52.758865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:52.772923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:52.773917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:52.774852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 442/904] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:52.782273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.830632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:52.866854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a1c21-897a-4bfb-8e97-168c6f63b672 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.891260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:52.896804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e059f-1174-4fdf-81da-1f84d51ea5cc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:52.902889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.903628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.904016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.904383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.905099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:52.906559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:52.915427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:52.916590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 10:58:52.917453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:52.918213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 463/905] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:52.923264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:52.939277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:52.940641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:52.941619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:52.942135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:52.943292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:52.943799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:52.946300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:52.970007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 443/906] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:52.975302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.068297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407233f-a3fc-4a8d-a4c3-30a7b64a8563 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.074502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:53.094899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000cd1b-61d9-44fb-89e5-cdba6db779b6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.113298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.113960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.114176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.114439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.115578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:53.115882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.117564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.124157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 464/907] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:53.134564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.148754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.149673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.150172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.150655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.205336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:53.222305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.224131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.271118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed34af-af34-4957-aa83-380e817e9687 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.305725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.306329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.306606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.306873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.307498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:53.307800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.309279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.319130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 465/908] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 10 10:58:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:53.320035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.326434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:53.353551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 444/909] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:58:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 10:58:53.354598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.447230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d327-7ee2-4024-9561-8951ba8a4034 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.467578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:53.475945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c894c5-f472-45b8-ac8f-6cd50d90b15f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.491447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.492061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.492347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.492598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.493488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.495300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.518406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.519420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.519916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.520419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.523532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 466/910] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:58:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:53.535040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.537332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-4e8979ba-1f2d-40bb-b535-9bf574e9e0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:53.557878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:53.558985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:53.559937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:53.559937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:53.559937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:53.562339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 445/911] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:53.568426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.682999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aee72-bc5d-47da-9ba8-e1fddea9692c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.683365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aee72-bc5d-47da-9ba8-e1fddea9692c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.683567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aee72-bc5d-47da-9ba8-e1fddea9692c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.688652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 446/912] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:53.690429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.690709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.690976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.695845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f74b2-3bfb-43a8-b8b9-0313ca31a464 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.710545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:53.713810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:53.746294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.746918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.747301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.747572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.748258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:53.748563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.750052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.750683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:53.763730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 467/913] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:53.769592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.800306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 447/914] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:53.803972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:53.824361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.899574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03202-09f3-4ee3-aa6c-e3477d570f3b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.940559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915a775-5ca0-4e2e-b345-460579c953a4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:53.949907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.950541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.951262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.951536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.961024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.962944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-bcba01f3-49d5-4ab3-887a-c9a43b4e6aac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:53.974267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:53.975377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:53.976275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:53.979412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:53.980066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.980313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 468/915] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:53.980424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.980594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.981207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:53.981601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff18a-605b-4d53-91b7-1717e759d766 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.981879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff18a-605b-4d53-91b7-1717e759d766 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.982140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff18a-605b-4d53-91b7-1717e759d766 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:53.982561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:53.987675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 469/916] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:53.987675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff18a-605b-4d53-91b7-1717e759d766 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-6c3a03de-f269-416b-8447-aaca8e454ba0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:53.995501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:53.996447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:53.997405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 448/917] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 10 10:58:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:53.998258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:53.998258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:53.998392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.017264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:54.018444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:54.042752 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:54.088778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 449/918] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:54.093196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:54.101945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:54.123083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff18a-605b-4d53-91b7-1717e759d766 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:54.161592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:54.162200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:54.162587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:54.162864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.163573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:54.163872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:54.165322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:54.182750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 470/919] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:54.182750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:54.206511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ecd5b-7282-407e-beac-b6e868ffd397 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:54.241769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:54.242412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:54.242685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:54.242952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.243575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:54.243864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:54.245459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:54.250586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 450/920] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:54.256397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:54.282164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:54.287653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75092c4-418b-4027-89bc-c17fe715d129 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:54.326068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:54.326687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:54.327223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:54.327491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.328370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:54.330627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:54.348134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 471/921] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:58:54 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:54.348963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:54.361561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55260e49-09c4-454b-aeb8-dcc87504cb01 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:54.371707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:54.415919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:54.416727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:54.417196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:54.417558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.418385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] RBAC: Adding query filter params (role.id=aae24fdfd06f4f928b67ab8ed6b2f1df, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:54.418797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:54.420392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:54.427479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 451/922] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:58:54 2022] GET /identity/v3/role_assignments?user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=aae24fdfd06f4f928b67ab8ed6b2f1df => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:54.487308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe74f9e-1f34-4749-afec-f7b10a7d69bc None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:54.529020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:54.529961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:54.530289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:54.530561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.531374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:54.531681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:54.533177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccdba6-b6bb-4966-968f-0b2281fa65dc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:54.539443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 472/923] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:54.545547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:54.643879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:54.661716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18029-a2fa-4518-ab86-1e0f80b1baa2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:54.697156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ca30-58c9-424a-8784-f19645e771b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:54.697758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ca30-58c9-424a-8784-f19645e771b7 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:54.698028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ca30-58c9-424a-8784-f19645e771b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:54.698315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ca30-58c9-424a-8784-f19645e771b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:54.698975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ca30-58c9-424a-8784-f19645e771b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:54.700387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ca30-58c9-424a-8784-f19645e771b7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:54.728117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 452/924] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:58:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:58:56.049900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0c40-cdab-4407-bbbd-1400942d59c9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.050428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0c40-cdab-4407-bbbd-1400942d59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.050768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0c40-cdab-4407-bbbd-1400942d59c9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.053670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 473/925] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:56.061489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5c87-fdf8-4345-83f7-af0ccada8cc4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.061974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5c87-fdf8-4345-83f7-af0ccada8cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.062336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5c87-fdf8-4345-83f7-af0ccada8cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.091853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2b8c5c87-fdf8-4345-83f7-af0ccada8cc4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:56.093796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2b8c5c87-fdf8-4345-83f7-af0ccada8cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:56.217426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 453/926] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:56.255522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa0c40-cdab-4407-bbbd-1400942d59c9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:56.359886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:56.392241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa0c40-cdab-4407-bbbd-1400942d59c9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:56.419774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01301fd-d346-481a-b6e7-d27c7bfda4cb None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.420084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01301fd-d346-481a-b6e7-d27c7bfda4cb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.420288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01301fd-d346-481a-b6e7-d27c7bfda4cb None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.422005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 454/927] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:58:56.426878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.427229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.427410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.429283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:56.429893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.430143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.430449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.431031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:56.432468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:56.436504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING keystone.server.flask.common [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 10:58:56.445795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:56.446977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:56.459611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.sql.core [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 10:58:56.459611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 10:58:56.459611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [parameters: {'id': '611be4da97b44e47bf254c80b5a53b45', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 10:58:56.459611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 611be4da97b44e47bf254c80b5a53b45.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 611be4da97b44e47bf254c80b5a53b45. Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 10:58:56.468158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 10:58:56.469452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application yield resource Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise self.value Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application session.commit() Aug 10 10:58:56.471213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.flush() Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application compat.raise_( Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 10:58:56.472358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 10:58:56.473493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 10:58:56.474471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [parameters: {'id': '611be4da97b44e47bf254c80b5a53b45', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.476085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:56.486247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 611be4da97b44e47bf254c80b5a53b45. Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 474/928] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 10 10:58:56 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:56.488234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:56.520379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:56.533287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 455/929] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:56.552342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:56.613197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4502-a2f0-4cee-af0b-0d53fecf0414 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:56.654521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:56.665190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:56.666022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.666820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.667180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.669905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecb5c7-002a-4882-b248-77c561ce91bd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:56.674749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:56.676515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:56.688846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:56.690199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:56.692152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 475/930] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:56.697819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:56.713347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:56.713984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.714486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.714762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.715353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:56.717567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:56.730262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:56.731765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:56.733350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 456/931] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:56.738341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:56.802600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:56.828621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce2743-ffcf-4cde-8b21-058902b6f36d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:56.851301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f302-47e1-4997-95d0-412631069329 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:56.865061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:56.865737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.866014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.866276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.866934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:56.867232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:56.868668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408497a-55bc-4141-bdb9-71c599074218 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:56.886915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:56.887737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.888210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.888616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.889007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 476/932] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:56.889567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:56.890103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:56.891677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225757b-bbd5-4cf4-9564-002eb2f42850 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:56.894646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5c345-4804-4ac4-8c54-63ff274d8b9d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.895046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5c345-4804-4ac4-8c54-63ff274d8b9d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.895414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5c345-4804-4ac4-8c54-63ff274d8b9d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.898292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 457/933] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:58:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:56.901116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 477/934] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:56.902710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:56.902954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:56.903232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:56.906140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5c345-4804-4ac4-8c54-63ff274d8b9d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:56.922737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:56.924094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:56.968576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.005004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 458/935] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:57.027033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.036446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5c345-4804-4ac4-8c54-63ff274d8b9d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.085075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.085733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.085949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.086217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.086848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:57.087143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.088534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041fe89-4173-4817-8103-cedc40a572d1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.095111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 478/936] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:58:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:57.097345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c3a2-fb9d-488a-a1fb-446e344b860e None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.097836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c3a2-fb9d-488a-a1fb-446e344b860e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.098277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c3a2-fb9d-488a-a1fb-446e344b860e None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.101045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 479/937] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:57.102016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c3a2-fb9d-488a-a1fb-446e344b860e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.105814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.160493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aa7db-5c6e-4b92-917d-7811f452ad6e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.197334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.197967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.198238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.198501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.199079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.200439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9fb63c6b-9fa5-44db-b178-7edc78f19606 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:57.209015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:57.210195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:58:57.211297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:57.215006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 459/938] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:57.216216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.216496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.216775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.217578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c3a2-fb9d-488a-a1fb-446e344b860e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.232293 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.234614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:57.235733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:57.258548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.259463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.259894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.260319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.261311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] RBAC: Adding query filter params (interface=public, service_id=76e38c7d809a49e2ae7ac0c8a6fe0891, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:57.261879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.263444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.269066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 480/939] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/endpoints?service_id=76e38c7d809a49e2ae7ac0c8a6fe0891&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:57.270283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.313265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 460/940] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:57.314318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.365766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.381202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f16f7-9751-46a1-81cd-740b123acea3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.416967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.417604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.417873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.418137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.418763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:57.419060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.420426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.421748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f025-b6a5-4de2-89fd-a6eba382bb23 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.425316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 481/941] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:57.426106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.460548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.461178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.461451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.461712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.462310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.463660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.469892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 461/942] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:58:57.470530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.482302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.567656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420e1fb-23f4-475c-bfff-31bd7b9a77f4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.589323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789871-d55e-4235-a141-0c6c59148c1d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.607126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.619901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.621594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.622384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.622860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.633424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.633965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.634234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.634500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.635128 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:57.635421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.636773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.638209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:58:57.642549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 462/943] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:58:57.643597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:57.644542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:57.645785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 482/944] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:57.650788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.777643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a47c52-6af6-4104-88cc-afcfeeb770f8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.817506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.821768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.821768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.821768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.821768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:57.821768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.821768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:57.830114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 463/945] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:57.835602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:57.937435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:57.939880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c31ff-bf64-4e68-8c4f-960840485c73 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:57.975939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:57.976580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:57.976856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:57.977160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:57.988404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:57.990109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:58.005507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:58.006536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:58.007414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:58.007414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:58.007414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:58.007414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 483/946] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:58.013961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:58.055079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:58.119286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5951-d44e-4aed-b9c0-e3f7144721d2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:58.157548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:58.158156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.158431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.158693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.159332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:58.159635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:58.160994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:58.173343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 464/947] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:58.179345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:58.280769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1704-a538-4411-9d2d-0c4cb7e4c28f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:58.314111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:58.314734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.315001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.315260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.322817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:58.324244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:58.335612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:58.336573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:58.337571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 484/948] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:58:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:58.342884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:58.444272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657103dc-0c4d-479a-9326-8273d7dc8322 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:58.454059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:58.481116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:58.482006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.482423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.482845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.483715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:58.484164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:58.485751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:58.503943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 465/949] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 10 10:58:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:58:58.509910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:58.525777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:58.614162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72fb8e-89ff-4abb-b3a2-b264b45d1e7b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:58.649573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:58.650210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.650482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.650746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.662084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:58.663725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:58:58.680750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:58.681814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:58:58.682730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:58:58.682730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:58:58.682730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:58.683387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 485/950] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:58.690096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:58.791894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab85d5-91d8-4a52-9543-259324ab0da4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:58.828429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:58.829084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.829363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.829631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.830277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:58.830578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:58.831946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5952ae-966a-43dd-96fe-7e6b4cf86a4c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:58.843942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 466/951] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:58.849638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:58.915740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:58.954700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327c465-3680-4cc6-99af-aa0d8d246c19 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:58.961806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46231714-db47-487a-ad12-90789c18a38e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.962088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46231714-db47-487a-ad12-90789c18a38e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.962360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46231714-db47-487a-ad12-90789c18a38e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.964463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 467/952] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:58.972538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:58.972816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:58.973114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:58.993482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:58.994662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:59.006008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:59.007922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.009065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.009191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.009582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.018194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.019750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:58:59.033499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:59.034405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:58:59.035458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:59.039604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 486/953] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:59.041078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.074173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 468/954] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:58:59.098237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.154103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a1e2-56f7-49a6-8900-1568b2772ad5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:59.178512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:59.191660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.193063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.193677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.194163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.195077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:59.195573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.197246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.210796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 487/955] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:59.216578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.237716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9023-67cf-4a3e-b4aa-bed63a365b2a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:59.283781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.284995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.285820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.286280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.287162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.289360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.293142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING keystone.server.flask.common [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 10:58:59.310748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.sql.core [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 10:58:59.310748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 10:58:59.310748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [parameters: {'user_id': '872ef16562b74346a42404499f9319ef', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 10:58:59.310748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application conn.query(q) Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application result.read() Aug 10 10:58:59.332664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 10:58:59.333809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application next(self.gen) Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application yield resource Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application next(self.gen) Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise self.value Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application session.commit() Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 10:58:59.334852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self.session.flush() Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application compat.raise_( Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 10:58:59.335797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 10:58:59.336777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application conn.query(q) Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application result.read() Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 10:58:59.337704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [parameters: {'user_id': '872ef16562b74346a42404499f9319ef', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:59.338619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 10:58:59.339442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 10:58:59.342781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 10:58:59.342781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 10:58:59.342781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 10:58:59.342781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 10:58:59.342781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 10:58:59.342781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:59.344488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 469/956] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 10 10:58:59 2022] POST /identity/v3/users => generated 160 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:58:59.347073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.359920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:59.361128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308724-2ab5-4fb1-9b1e-9941862d625a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:59.406818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.408311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.408920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.409534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/55bc1cb8ee2a4dd3a47961c8189d2ec5/roles/aae24fdfd06f4f928b67ab8ed6b2f1df` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.412732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=55bc1cb8ee2a4dd3a47961c8189d2ec5, role_id=aae24fdfd06f4f928b67ab8ed6b2f1df)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.414976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.435429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 488/957] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:58:59 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/55bc1cb8ee2a4dd3a47961c8189d2ec5/roles/aae24fdfd06f4f928b67ab8ed6b2f1df => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:58:59.470530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b1ec1-672b-4e40-afb5-0b0891b8117c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:59.513808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.514907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.515422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.515941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.525192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.527262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-8b0b8f88-b728-437b-b02c-cf09deaec826 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:58:59.542983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:59.544052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 10:58:59.545078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:58:59.547966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 470/958] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:58:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:59.554190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.606969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:59.646549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce11c2-c575-4f4a-bbb6-7c9af88bcc4c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.647208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce11c2-c575-4f4a-bbb6-7c9af88bcc4c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.647536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce11c2-c575-4f4a-bbb6-7c9af88bcc4c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.651793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 471/959] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:59.659411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd295e-b037-4ac2-a916-271a37fbb60a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.659754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd295e-b037-4ac2-a916-271a37fbb60a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.660087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd295e-b037-4ac2-a916-271a37fbb60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.675165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5a997-eb2a-4329-93b1-34a94a76a276 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:59.682966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-55dd295e-b037-4ac2-a916-271a37fbb60a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:59.684923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-55dd295e-b037-4ac2-a916-271a37fbb60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:59.711185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.711711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.711984 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.712254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.712956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:58:59.713286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.714723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae9415-b8de-4c8a-bbe6-83d1396dcf78 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.761140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 489/960] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 10 10:58:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:58:59.766901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:59.777420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 472/961] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:59.787269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19865c-d18e-46bd-8c45-de9b47081cba None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.787565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19865c-d18e-46bd-8c45-de9b47081cba None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.787823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19865c-d18e-46bd-8c45-de9b47081cba None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.789705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 490/962] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:58:59.797067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19865c-d18e-46bd-8c45-de9b47081cba None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.797819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.798242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.798749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.820090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:58:59.821872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:58:59.913015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 473/963] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:58:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:58:59.926603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19865c-d18e-46bd-8c45-de9b47081cba None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:58:59.928305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:58:59.931715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:58:59.974524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:58:59.975150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:58:59.975423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:58:59.975687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:58:59.976270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:58:59.977685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:58:59.990420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:58:59.991520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:58:59.992364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 491/964] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:58:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:58:59.997690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:00.056936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f681-6de7-4c61-b94b-0558a029c7ce None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:00.088321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:00.097220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:00.097830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:00.098102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:00.098373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:00.099017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:00.100491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:00.112938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0745-c9da-454e-9fed-82c352fad393 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:00.117117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 474/965] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:58:59 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:59:00.164520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:00.165176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:00.165450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:00.165710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:00.166342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:00.166639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:00.168142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:00.178952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 492/966] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:58:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:00.180021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:00.292042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bea12-e41e-4fd6-b56d-885dc152949c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:00.327542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:00.328151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:00.328424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:00.328689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:00.329348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:00.329639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:00.331003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f3b5-b718-46a0-b67c-c8036e859720 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:00.336074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 475/967] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:59:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:00.341807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:00.370397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:00.445680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0244a-0924-4abf-84da-f71674266740 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:00.478924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce2b7b-4225-494d-bde5-0b4d4691b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:00.479526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2b7b-4225-494d-bde5-0b4d4691b980 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:00.479820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2b7b-4225-494d-bde5-0b4d4691b980 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:00.480085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2b7b-4225-494d-bde5-0b4d4691b980 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:00.480742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2b7b-4225-494d-bde5-0b4d4691b980 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:00.482152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2b7b-4225-494d-bde5-0b4d4691b980 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:00.504958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 493/968] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:59:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:01.506704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385642-54ca-4de3-b38a-35531cd2c04e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:01.507219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385642-54ca-4de3-b38a-35531cd2c04e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:01.507219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385642-54ca-4de3-b38a-35531cd2c04e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:01.508671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 476/969] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:01.513946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:01.514353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:01.514540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:01.532930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:01.534466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:01.614884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 494/970] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:01.638794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385642-54ca-4de3-b38a-35531cd2c04e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:01.693610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:01.746655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385642-54ca-4de3-b38a-35531cd2c04e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:01.781391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:01.782016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:01.782290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:01.782554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:01.793436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:01.798067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:01.798981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:01.799815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:01.804578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 477/971] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 10 10:59:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:01.805925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:01.816227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:01.908087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926872c-0ab4-4a4b-a090-42dac5106850 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:01.942409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:01.943015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:01.943287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:01.943581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:01.944240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:01.944538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:01.945941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c2116-6bb7-4a65-8918-b40895edb630 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:01.954591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 495/972] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:59:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:01.960350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.062140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f53b6-4be9-498d-ae6a-0e66a6cabe48 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.074992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.095146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428d222-1186-46d0-b0e0-2dcaefe00edc None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.095509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428d222-1186-46d0-b0e0-2dcaefe00edc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.095836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428d222-1186-46d0-b0e0-2dcaefe00edc None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.097410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 496/973] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:02.097623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.098316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.098690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.099018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.102580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.102853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.103117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.111030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.112569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.122191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:02.123354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:02.132835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:02.133941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:02.134991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:02.134991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:02.134991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:02.138994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 478/974] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:02.140196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.194349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.205030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 497/975] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:59:02.222003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.246883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a3cd-5a1c-468f-a030-6758f81af992 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.281850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.282454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.282726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.283028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.283778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:02.284073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.285570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.303223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 479/976] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:02.304262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.328769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff65d-09d1-4d25-b9c2-3ec4017b2c68 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.329342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.364224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.364855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.365168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.365470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.366054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.367442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:02.376006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:02.377038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:02.377905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 498/977] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:59:02.383765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.410721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc05cf-489e-4e62-addb-7db42bd0f162 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.445547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.446174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.446442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.446711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.450076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.455032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.456270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:59:02.468659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:02.470115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:02.471491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 480/978] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:02.475457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.493427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942782-194e-4399-a775-6f0d1b431e7d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.526467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.527201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.527312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.527564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.528179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:02.528466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.529869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b071c-cb1d-4cc0-832d-145745056524 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.539473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 499/979] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:02.539473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab11c-b105-49c4-9f6f-5405fe72ef77 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.539473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab11c-b105-49c4-9f6f-5405fe72ef77 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.539473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab11c-b105-49c4-9f6f-5405fe72ef77 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.539473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 500/980] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:02.541825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab11c-b105-49c4-9f6f-5405fe72ef77 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.558270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.574687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362ea5-c733-4e0f-a89c-a33c7f03c0cd None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.608877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.609428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.609716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.609977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.610700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:02.610993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.612410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919411-9d97-4822-9db3-7f2f5b660e31 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.630769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 481/981] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:02.632023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.632301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.632559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.650922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:02.652124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:02.652437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab11c-b105-49c4-9f6f-5405fe72ef77 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.677499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.685158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.685753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.686022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.686288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.686900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:02.687194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.688552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.693345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 501/982] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:02.694120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.719232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 482/983] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:02.720133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.791106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.795237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32212f-7488-4505-85da-24f3090177e8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.822546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdbc8e-2178-43a5-9433-52339c98374a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.828336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.828929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.829236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.829516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.856423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:02.857054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:02.857322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:02.857585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:02.858268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] RBAC: Adding query filter params (interface=public, service_id=6d1ded6769994113b41db9e6e7b85305, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:02.858563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.859971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.864716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 483/984] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/endpoints?service_id=6d1ded6769994113b41db9e6e7b85305&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:02.865560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:02.888929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:02.900298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:02.901814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:02.966179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8e4c-9edf-4cc6-a6c5-77249c0dc27c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:02.996188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 502/985] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:02.997340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.000110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.000738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.001027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.001302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.001880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.003256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.006543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:03.013334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:03.014530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:03.015734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 484/986] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:03.016574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.091314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.100368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b2d0-aa5e-4c32-9cba-2be8b6a72d91 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.116838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd45fe-c8f3-4db1-b784-6b13188fd94e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.135912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.136500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.136771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.137057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.137652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.139047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.145200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 503/987] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:59:02 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:59:03.145966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.151617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.152277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.152553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.152820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.166896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.168957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:03.188627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:03.189855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:03.190743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:03.190743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:03.190743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:03.190743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 485/988] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:03.196687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.255761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8538-4bbb-4d53-8c58-a40e07e5bbd6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.256330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.296133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.296746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.297047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.297318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.297953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:03.298253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.299922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.305250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 504/989] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:03.309626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c348172-5ad5-4642-b629-bd53944d868f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.311474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.334329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.350185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.350795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.351063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.351325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.351964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:03.352256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.353636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.365808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 486/990] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:03.371355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.419562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051bd2d-e959-4ebc-866a-6c002322f636 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.457860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.458469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.458737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.459115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.459746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:03.460042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.461499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.466446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 505/991] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:03.472222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.485013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2057-7f2a-40f8-82a0-b2b850687835 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.499880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.524451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.525132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.525398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.525673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.532995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.534453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:59:03.545599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:03.546491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:03.547374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 487/992] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:59:03.552593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.561292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.579683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779c3af-c743-4d2b-9e72-e9790037e21b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.618300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.619177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.619447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.619874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.620893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] RBAC: Adding query filter params (interface=admin, service_id=76e38c7d809a49e2ae7ac0c8a6fe0891, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:03.621646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.623048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.630593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 506/993] 10.222.0.42 () {56 vars in 1249 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/endpoints?service_id=76e38c7d809a49e2ae7ac0c8a6fe0891&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:03.636175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.664821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf5453-3c02-4c45-abcb-395d06c3e5b9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.700767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.701413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.701689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.701956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.702650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:03.702949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.704378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.716996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 488/994] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:03.722665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:03.745403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46d78-4032-4d92-b243-36c02bcc6ae3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.760139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:03.780550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3933dc-3b28-4419-9028-4135a3082dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.781175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3933dc-3b28-4419-9028-4135a3082dac None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.781448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3933dc-3b28-4419-9028-4135a3082dac None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.781716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3933dc-3b28-4419-9028-4135a3082dac None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.782319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3933dc-3b28-4419-9028-4135a3082dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.783697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3933dc-3b28-4419-9028-4135a3082dac None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.801012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 507/995] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:59:03.852724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7808091-5016-4cb5-9917-38b8fdb9601a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:03.891474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:03.892009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:03.892281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:03.892551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:03.893333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] RBAC: Adding query filter params (role.id=aae24fdfd06f4f928b67ab8ed6b2f1df, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:03.893636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:03.895080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa702e-3880-4877-807a-850b6535f9aa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:03.901845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 489/996] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:03 2022] GET /identity/v3/role_assignments?user.id=55bc1cb8ee2a4dd3a47961c8189d2ec5&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=aae24fdfd06f4f928b67ab8ed6b2f1df => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:05.119570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d929-39e8-42d9-a71d-a7a64cbf8570 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.120174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d929-39e8-42d9-a71d-a7a64cbf8570 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.120174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d929-39e8-42d9-a71d-a7a64cbf8570 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.121662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 508/997] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:05.127739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.128968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.129612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.148264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:05.149491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:05.218728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 490/998] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:05.240939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d929-39e8-42d9-a71d-a7a64cbf8570 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:05.257361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:05.348751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d929-39e8-42d9-a71d-a7a64cbf8570 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:05.383944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:05.384486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.384758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.385026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.385618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:05.386994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:05.395715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:05.396717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:05.402508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 509/999] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:59:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:05.405043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:05.434439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:05.510654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b16af1-1591-4fbb-ae2b-381b89028076 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:05.545848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:05.546501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.546775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.547050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.547728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:05.548025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:05.549498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:05.559275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 491/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:59:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:05.560580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:05.643098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:05.667268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4defe2-3b18-417e-baae-7f0ebeed3478 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:05.700670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:05.701300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.701573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.701837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.702462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:05.702756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:05.704122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824aace-54c2-4ac7-8d58-b10cfd1cb9e8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:05.709240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 510/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 10 10:59:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:05.714772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:05.782143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795bc6-f442-4279-9014-0624a377b1d4 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.782416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795bc6-f442-4279-9014-0624a377b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.782682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795bc6-f442-4279-9014-0624a377b1d4 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.784174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 511/1002] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:59:05.789145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ee301-3bda-487a-80a3-bba1162c913b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.789418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ee301-3bda-487a-80a3-bba1162c913b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.789697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ee301-3bda-487a-80a3-bba1162c913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.807727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c75ee301-3bda-487a-80a3-bba1162c913b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:05.808908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c75ee301-3bda-487a-80a3-bba1162c913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:05.809603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:05.820516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca870033-fff8-4bdb-8cf9-d4aab4d3a975 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:05.856533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:05.857163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.857436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.857690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.858351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:05.859709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:05.885023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 512/1003] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:59:05.885216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 492/1004] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:59:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:05.900913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43c1dc-f13c-4439-9db3-68c97462d961 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.901128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43c1dc-f13c-4439-9db3-68c97462d961 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.901496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43c1dc-f13c-4439-9db3-68c97462d961 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.903231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 513/1005] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:05.903348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:05.909842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:05.910171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:05.910440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:05.929882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:05.931145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:05.999407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:06.011699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 514/1006] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:05 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:06.030518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2608-ddf2-4b24-ad06-d0462efbbb3a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.033539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:06.071134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.071752 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.072448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.072448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.072841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.074602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:06.083744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:06.084862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 10:59:06.085938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:06.086797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 493/1007] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 10 10:59:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:59:06.092489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:06.106389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:06.162743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e82f1-8e4a-4e69-9505-c5e76b27c625 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.198100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.198735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.199005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.199269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] PATH_INFO: `/v3/services/image` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.199851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.201324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:06.209991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:06.211280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:06.212144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 515/1008] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 10 10:59:06 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:06.214825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daa859-f100-4b44-8a22-0b5b7554824a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.216899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:06.257740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab846509-5b16-4064-9df5-551940520862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.258702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab846509-5b16-4064-9df5-551940520862 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.258966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab846509-5b16-4064-9df5-551940520862 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.259241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab846509-5b16-4064-9df5-551940520862 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.260179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab846509-5b16-4064-9df5-551940520862 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:06.260759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab846509-5b16-4064-9df5-551940520862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.262335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab846509-5b16-4064-9df5-551940520862 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.273374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 494/1009] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:59:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:06.275084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:06.275200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab846509-5b16-4064-9df5-551940520862 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:06.315694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cda92-5e2e-4041-aff4-48ac6710b19f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.352218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.352932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.353234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.353498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.354122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] RBAC: Adding query filter params (name=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:06.354416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.355813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.360312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:06.360907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 516/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:06.366447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:06.388175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab846509-5b16-4064-9df5-551940520862 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.427524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.428155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.428475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.428740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.429398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:06.429688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.433404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.437198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 495/1011] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 10 10:59:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:06.442627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:06.473234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e310-dc43-4dcb-81d4-7919daf79d3d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.498487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:06.510810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.511522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.511804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.512068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.512694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] RBAC: Adding query filter params (type=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:06.513019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.514379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a207d-c363-4450-a3b1-2ab721acff0e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.529384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 517/1012] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:06.543769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160b79b-d7ae-4fe1-a2c0-594e2bf17088 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:06.581542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95c09-b08a-4459-89ab-310280edb74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:06.582164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95c09-b08a-4459-89ab-310280edb74e None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:06.582433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95c09-b08a-4459-89ab-310280edb74e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:06.582693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95c09-b08a-4459-89ab-310280edb74e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:06.583357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a95c09-b08a-4459-89ab-310280edb74e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:06.584828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a95c09-b08a-4459-89ab-310280edb74e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:06.597624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:06.613477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 496/1013] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:59:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:59:07.960274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c309d0-2a0b-447d-ab54-169d248c4505 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:07.960807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c309d0-2a0b-447d-ab54-169d248c4505 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:07.960807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c309d0-2a0b-447d-ab54-169d248c4505 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:07.962259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 518/1014] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:07.967493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:07.967924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:07.968003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:07.986444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:07.987620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:08.064078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 497/1015] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:07 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:08.086986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c309d0-2a0b-447d-ab54-169d248c4505 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.206263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c309d0-2a0b-447d-ab54-169d248c4505 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.240822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:08.241383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.241654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.241914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.252391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:08.257514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:08.258420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:08.264331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 519/1016] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 10 10:59:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:08.265075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.362717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479fc4d-bd05-4f62-af75-ae6794f242c1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.387079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:08.398766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:08.399369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.399638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.399894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.400545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:08.400840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:08.402235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d0ef8-70a9-4323-a06c-2969c309701c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:08.415175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 498/1017] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:59:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:08.416142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.466275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:08.513859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef3df-f3f0-4bb8-b370-17358197a786 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.514039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef3df-f3f0-4bb8-b370-17358197a786 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.514288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef3df-f3f0-4bb8-b370-17358197a786 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.515868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 499/1018] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:59:08.519453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0abd-9f7d-42a3-b54a-73a917a0c069 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.521327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2d947-8752-40fd-beb3-81c51654ef3a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.521736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2d947-8752-40fd-beb3-81c51654ef3a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.521935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2d947-8752-40fd-beb3-81c51654ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.539698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-33f2d947-8752-40fd-beb3-81c51654ef3a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:08.540879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-33f2d947-8752-40fd-beb3-81c51654ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:08.555161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:08.555786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.556058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.556324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.566961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:08.568447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-daeebfe3-cc76-420d-bcfb-6e4fa71f79b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:08.582637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:08.583819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:08.585089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:08.585089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:08.585089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:08.585089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 520/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:59:08.585382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b425ab-5cd5-44ef-89b3-e60bc1e1ca72 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.585501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b425ab-5cd5-44ef-89b3-e60bc1e1ca72 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.585829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b425ab-5cd5-44ef-89b3-e60bc1e1ca72 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.587048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 521/1020] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:08.589333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b425ab-5cd5-44ef-89b3-e60bc1e1ca72 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.611354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 500/1021] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:59:08.612591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.612868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.613168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.631346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:08.632538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:08.691047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:08.696143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b425ab-5cd5-44ef-89b3-e60bc1e1ca72 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.697207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 501/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:08.697842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.732856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:08.733487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.733758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.734020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.734652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:08.734944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:08.736291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:08.745429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:08.748221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 522/1023] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:08.749037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.800189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf430b3-7243-4204-a437-7413a58922a8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.834138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:08.834740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.835013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.835274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.835893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:08.837282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:08.845207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2a8e6-f1e7-42fe-8cf0-ffa1dc556b55 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.852532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 502/1024] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:59:08 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:08.853634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.889813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:08.890455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:08.890725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:08.890981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:08.892147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:08.893645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:08.895276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 523/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:08.901330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:08.929685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:08.967618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9aae5-345f-4fc2-857c-042381c4f2ed None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:08.976575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:09.010972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:09.011779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:09.012055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:09.012321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:09.020429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:09.021954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:09.024228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d3cfc-c091-4314-9511-dd97f271eb60 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:59:09.033008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:09.034005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:09.035266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 503/1026] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:59:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:09.040283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:09.062649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:09.063175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:09.063448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:09.063712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:09.064351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:09.065911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:09.094029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 524/1027] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:59:08 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:09.158191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e657d-388f-4c1d-92c9-d536739f76a0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:09.196881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:09.197536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:09.197803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:09.198119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:09.198855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:09.199150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:09.200600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:09.221482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 504/1028] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:59:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:09.228066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:09.312263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:09.337151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b2502-b52b-4324-9a33-cc270e314833 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:09.371841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:09.372449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:09.372726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:09.372992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:09.440688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:09.442186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:09.516260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:09.540971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 525/1029] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:09.546674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:09.571877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:09.648650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf5720-a4ae-45c4-a3d0-a423a40d48e5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:09.681941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:09.682569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:09.682840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:09.683100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:09.693062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:09.694546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:09.708683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:09.709657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:09.710570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:09.710570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:09.710570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:09.713082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 505/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:09.715660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:09.815481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185423-6420-4852-bf08-6c26651a51c4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:09.849250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:09.849901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:09.850172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:09.850437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:09.851073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:09.851369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:09.852741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:09.864372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 526/1031] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:09.869953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:09.951009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:09.976140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3e63-6f37-4114-bdb2-0c1c695752ed None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:10.012781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:10.013453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:10.013728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:10.013991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:10.020819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:10.022350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:59:10.033617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:10.034490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:10.040554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 506/1032] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:10.042285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:10.078630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:10.152559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a03a5-f81c-4920-ae22-334bc4a7afdd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:10.186677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c168-7120-4533-9754-b735660793dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:10.187271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c168-7120-4533-9754-b735660793dc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:10.187538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c168-7120-4533-9754-b735660793dc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:10.187801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c168-7120-4533-9754-b735660793dc None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:10.188472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c168-7120-4533-9754-b735660793dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:10.188765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c168-7120-4533-9754-b735660793dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:10.190218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c168-7120-4533-9754-b735660793dc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:10.207173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 527/1033] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:10.208762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:10.314268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f6bc2-eda1-4ba6-8db4-7408d4465ac9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:10.347633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:10.348230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:10.348500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:10.348769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:10.349594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] RBAC: Adding query filter params (role.id=aae24fdfd06f4f928b67ab8ed6b2f1df, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=ded8e23edf404c378eba94e917be0c8e) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:10.349872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:10.351296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48838d7c-cdfb-4286-a564-0f4b1ec076bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:10.354142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:10.365458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 507/1034] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:10 2022] GET /identity/v3/role_assignments?user.id=ded8e23edf404c378eba94e917be0c8e&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=aae24fdfd06f4f928b67ab8ed6b2f1df => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:10.861913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0ceb-bb09-4570-af06-9066113d935d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:10.862327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0ceb-bb09-4570-af06-9066113d935d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:10.862427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0ceb-bb09-4570-af06-9066113d935d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:10.863763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 528/1035] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:10.869228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd137-5171-4431-b787-36c657997ce6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:10.869572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd137-5171-4431-b787-36c657997ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:10.869906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd137-5171-4431-b787-36c657997ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:10.889015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ab5cd137-5171-4431-b787-36c657997ce6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:10.890187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ab5cd137-5171-4431-b787-36c657997ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:10.957908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 508/1036] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:59:10.980058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0ceb-bb09-4570-af06-9066113d935d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.077908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:11.086445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0ceb-bb09-4570-af06-9066113d935d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.104788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032d4fc-9699-4ff3-9f03-8c40686f5a16 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.105369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032d4fc-9699-4ff3-9f03-8c40686f5a16 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.105449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032d4fc-9699-4ff3-9f03-8c40686f5a16 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.106980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 509/1037] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:59:11.111686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.112017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.112222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.130799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.131402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.131675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.131941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] PATH_INFO: `/v3/services/image` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.132541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.133939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.134993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:11.136173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:11.142945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:11.143944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:11.144806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 529/1038] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 10 10:59:10 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:11.150326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.210498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 510/1039] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 10:59:11.234261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.247664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a57ca-0653-40cb-98be-d7c08a2b27cd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.284707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.285411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.285643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.285904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.286550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:11.286846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.288278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.292712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:11.293074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 530/1040] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:11.298789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.325921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:11.336826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcc9fb-9854-4007-88cd-47ea72d6c7a3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.373685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.374230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.374499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.374781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.375916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.377372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.379122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 511/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:11.385024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.406990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864bf1-9c66-4131-a280-df6426f085d7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.444001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.444905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.445282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.445452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.446156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] RBAC: Adding query filter params (type=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:11.446366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.447724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.452794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 531/1042] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:11.458289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.491213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3027d7-b3a5-4d00-9750-21d6cd574416 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.518885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:11.527808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.528415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.528695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.528962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.529623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.531053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.552842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:11.553615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 512/1043] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:59:11 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:59:11.566990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6ba2-001a-4de6-88de-e9f28dd33e32 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.604847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.605528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.605802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.606070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.606794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] RBAC: Adding query filter params (interface=public, service_id=0e136d9b645344caac200cec7e35c032, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:11.607094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.608549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6b0a0-72fb-4fde-8279-538fa77558bf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.619240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 532/1044] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 10:59:11 2022] GET /identity/v3/endpoints?service_id=0e136d9b645344caac200cec7e35c032&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:11.620612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:11.730284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e27533-6256-4a2c-a0d4-33fe765db420 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:11.765040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13bc8f-7852-4285-b13d-e1be7a7733b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:11.765784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13bc8f-7852-4285-b13d-e1be7a7733b4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:11.766046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13bc8f-7852-4285-b13d-e1be7a7733b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:11.766347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13bc8f-7852-4285-b13d-e1be7a7733b4 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:11.766919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13bc8f-7852-4285-b13d-e1be7a7733b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:11.768254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13bc8f-7852-4285-b13d-e1be7a7733b4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:11.775113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 513/1045] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 10:59:11 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:59:12.319724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eb346-b1d8-4dd7-9fad-1284397815ed None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:12.320266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eb346-b1d8-4dd7-9fad-1284397815ed None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:12.320266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eb346-b1d8-4dd7-9fad-1284397815ed None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:12.325016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 533/1046] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:12.326817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:12.327252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:12.327331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:12.345810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:12.346985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:12.392870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:12.420903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 514/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:12.442784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eb346-b1d8-4dd7-9fad-1284397815ed None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:12.545928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eb346-b1d8-4dd7-9fad-1284397815ed None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:12.578494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:12.579113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:12.579382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:12.579643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:12.590279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:12.594930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:12.595882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:12.596734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:12.600680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 534/1048] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 10 10:59:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:12.602636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:12.705378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440879bd-74d6-4fa9-b724-dc379763e95f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:12.749262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:12.749867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:12.750136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:12.752291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:12.752291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:12.752291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:12.752680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:12.765378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 515/1049] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:59:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:12.767550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:12.783872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:12.874068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d3e4-ae56-4788-a1d4-3b3fb5786ba8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:12.908372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:12.909164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:12.909537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:12.909904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:12.920689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:12.922369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:12.936415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:12.937615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:12.938735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:12.938735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:12.938735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:12.939898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 535/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:12.945657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:12.990245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:13.053487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2de2-ce20-4d69-aa4d-6dcaff000382 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.097713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.098467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.098838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.099198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.099967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:13.100358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:13.101867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:13.118844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 516/1051] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:13.122229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.190304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:13.231126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711829-4e87-4e5a-a2bb-c82e41bef675 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.265384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.265933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.266210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.266469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.275057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:13.276493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:59:13.287526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:13.288505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:59:13.289496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:13.293344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 536/1052] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:13.294509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.395670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:13.400296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab1be3-cb68-4bf2-8d3b-adf949cea9a0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.435680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.436288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.436556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.436817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.437578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:13.437871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:13.439286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0709ba-dc82-4a26-894f-94887e9c42a7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:13.456737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 517/1053] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:13.462269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.561763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03baf9-5d95-4699-b1f1-be84739a50dd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.584863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:13.596874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.597526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.597797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.598057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.608953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:13.610424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:13.612264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d7b3-de91-44ca-a92c-a9ec0b20b894 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.612698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d7b3-de91-44ca-a92c-a9ec0b20b894 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.612965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d7b3-de91-44ca-a92c-a9ec0b20b894 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.614370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 518/1054] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:13.619327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510300b9-b11a-4aa6-b45a-4634ad832282 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.619601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510300b9-b11a-4aa6-b45a-4634ad832282 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.619865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510300b9-b11a-4aa6-b45a-4634ad832282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:13.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:13.632311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:13.633222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:13.633222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:13.633222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:13.633222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 537/1055] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:13.638059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.642880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-510300b9-b11a-4aa6-b45a-4634ad832282 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:13.644055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-510300b9-b11a-4aa6-b45a-4634ad832282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:13.714001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 519/1056] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:13.723737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf35df-8efb-43e9-a9a4-f63e65c5acf2 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.724014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf35df-8efb-43e9-a9a4-f63e65c5acf2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.724281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf35df-8efb-43e9-a9a4-f63e65c5acf2 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.726018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 520/1057] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:59:13.731350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.731647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.731909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.746276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88a98-32fd-4019-b6c4-c21bbaad61b1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.749415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:13.750585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:13.779352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.779957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.780234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.780500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.781174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:13.781472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:13.782847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:13.794995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 538/1058] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:13.795781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.814588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 521/1059] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:13.815662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.831801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:13.836049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:13.895567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077aaf7-561b-47f7-aa50-5f95d454082b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.915465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c6238-6e8e-4db0-8b75-efc4a7635e4a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:13.930096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.930720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.930973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.931331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.941508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:13.946121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:13.947231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 539/1060] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:13.948170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:13.950737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:13.951377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:13.951672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:13.951927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:13.959163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:13.960617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:59:13.971930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:13.972832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 522/1061] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:13.978937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.042401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.048695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281cc26-1fa0-40f2-b202-6c5694b3d751 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.055767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.076861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e466c-930a-4936-9dd2-c8e9951c7341 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.082320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.082944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.083215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.083483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] PATH_INFO: `/v3/services/image` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.084131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.085535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:14.093923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:14.095087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:14.096204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 540/1062] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:14.097063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.110425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.111033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.111305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.111567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.112219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:14.112510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.113922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.122421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 523/1063] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:14.123256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.197599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03765d-4c99-4da7-8c2d-84b852098643 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.219364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb86f-361f-48f3-899c-bf834acb9dcf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.230563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.231161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.231458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.231716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.232363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:14.232692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.234135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.245700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 541/1064] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:14.246476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.253643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.254616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.254996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.255260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.255972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:14.256267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.257656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.262356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 524/1065] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:14.263100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.267331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.274706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.349517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024d444-931e-49a3-ba4c-bd14c1b19c56 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.358693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc1d2-b0d7-40a9-a3b5-b64a89561cf0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.382738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.383361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.383607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.383902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] PATH_INFO: `/v3/users/339850be5bc04d539db674c5d3404381` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.392960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.393631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.393899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.394159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/ded8e23edf404c378eba94e917be0c8e/roles/aae24fdfd06f4f928b67ab8ed6b2f1df` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.396289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=ded8e23edf404c378eba94e917be0c8e, role_id=aae24fdfd06f4f928b67ab8ed6b2f1df)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.397056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] RBAC: Authorizing `identity:get_user(user_id=339850be5bc04d539db674c5d3404381)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.397742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.398476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.400082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 542/1066] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/users/339850be5bc04d539db674c5d3404381 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:14.400833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.415938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 525/1067] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:59:14 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/ded8e23edf404c378eba94e917be0c8e/roles/aae24fdfd06f4f928b67ab8ed6b2f1df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:59:14.417004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.497729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.499686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.525884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d16807-d212-4b72-be9a-69aa662b3f58 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.539791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122374-1308-405a-ac1c-0b05b1219324 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.563902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1813-f941-4940-87eb-992537496ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.564518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1813-f941-4940-87eb-992537496ffb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.564848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1813-f941-4940-87eb-992537496ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.565099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1813-f941-4940-87eb-992537496ffb None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.565796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f1813-f941-4940-87eb-992537496ffb None admin] RBAC: Adding query filter params (type=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:14.566035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f1813-f941-4940-87eb-992537496ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.567413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f1813-f941-4940-87eb-992537496ffb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.573094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 543/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:14.581270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1813-f941-4940-87eb-992537496ffb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.582841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.583635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.584114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.584883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.656834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.658218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.686525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1813-f941-4940-87eb-992537496ffb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.717076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.725381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.726165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.726438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.726766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.727501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.729059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.746239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:14.754758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 544/1069] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 10:59:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:14.774432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 526/1070] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:14.776174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:14.905352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25808f14-f00a-47eb-a85b-f016c32963ef None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:14.942946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b07d-098a-4142-b558-94f40c25f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:14.943615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b07d-098a-4142-b558-94f40c25f789 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:14.943891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b07d-098a-4142-b558-94f40c25f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:14.944161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b07d-098a-4142-b558-94f40c25f789 None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:14.945320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b07d-098a-4142-b558-94f40c25f789 None admin] RBAC: Authorizing `identity:get_project(project_id=6f97e5bed1b54729821c709cf9e8b4b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:14.946770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b07d-098a-4142-b558-94f40c25f789 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:14.948790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 545/1071] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:14.954870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:15.055209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d72fc-49d7-4ac1-8b22-f187f7c16e09 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:15.089602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:15.090201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:15.090471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:15.090734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:15.091448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6, user.id=339850be5bc04d539db674c5d3404381) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:15.091746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:15.093273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad1ee7-126b-46cc-8846-48c2ffd859a0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:15.098907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 527/1072] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:14 2022] GET /identity/v3/role_assignments?user.id=339850be5bc04d539db674c5d3404381&scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:16.425859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf48a1b-aa6b-4ce3-b123-76f619f45554 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:16.426399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf48a1b-aa6b-4ce3-b123-76f619f45554 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:16.426399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf48a1b-aa6b-4ce3-b123-76f619f45554 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:16.427658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 546/1073] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:16.433088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:16.433509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:16.433607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:16.451730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:16.452912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:16.475701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:16.521073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 528/1074] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:16.550566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf48a1b-aa6b-4ce3-b123-76f619f45554 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:16.627108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:16.671208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf48a1b-aa6b-4ce3-b123-76f619f45554 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:16.705596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2896e4c-64b4-45c2-8910-2cf3b26a7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:16.706135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896e4c-64b4-45c2-8910-2cf3b26a7f47 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:16.706409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896e4c-64b4-45c2-8910-2cf3b26a7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:16.706674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896e4c-64b4-45c2-8910-2cf3b26a7f47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:16.717555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2896e4c-64b4-45c2-8910-2cf3b26a7f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-d2896e4c-64b4-45c2-8910-2cf3b26a7f47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:16.722174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:16.723117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 10:59:16.723946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:16.728807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 547/1075] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 10 10:59:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:59:16.729715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:16.827676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b28b7-100b-44e8-97fa-3080afd39358 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:16.848833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c645b7-8b80-477f-afe8-eee57676bf0a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:16.849142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c645b7-8b80-477f-afe8-eee57676bf0a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:16.849458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c645b7-8b80-477f-afe8-eee57676bf0a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:16.851022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 548/1076] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 10:59:16.855714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:16.856073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:16.856433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:16.869013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:16.869642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:16.869916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:16.870182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:16.870852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:16.871148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:16.872513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:16.880144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:16.881434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:16.885083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 529/1077] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:59:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:16.889450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:16.914006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:16.957464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 549/1078] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:16.979169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:16.996266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4fa78-25dc-49a0-883a-ff44b15a9de7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.031619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.032379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.032490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.032746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.043642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.045271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.047714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-4389bd79-fae7-4547-9f9f-8ec9455c630b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:17.060748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:17.066528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 530/1079] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5390-ae2d-4e87-b271-f4c2538d8aa1 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5390-ae2d-4e87-b271-f4c2538d8aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5390-ae2d-4e87-b271-f4c2538d8aa1 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.067693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 531/1080] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:17.069963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a5390-ae2d-4e87-b271-f4c2538d8aa1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.094480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94166c-7d14-468c-b313-fa6b28fe6508 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.131159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.131786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.132050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.132309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.139865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.170360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a5390-ae2d-4e87-b271-f4c2538d8aa1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.197768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.199327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.202808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.203420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.203692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.203956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.204588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:17.204882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.206273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f61d3-7ea4-4cfa-a492-a803b27d8de8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.219028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 532/1081] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:17.221954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.221954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.221954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.241295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:17.242502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:17.255823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.302164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 550/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 10:59:17.303115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.308529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 533/1083] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:17.309396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.371772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.405897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de979215-1693-4f3e-a6cf-b06c065fd981 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.411505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910e9c5-c8f6-455c-8314-cb0b8cbeec63 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.440245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.440839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.441166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.441427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.445536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.446159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.446428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.446690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.448455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.449927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.456395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.457819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 10:59:17.461941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:17.462995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 551/1084] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:17.464019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:17.472131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:17.473299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:17.474412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:17.474412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:17.474412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:17.474412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 534/1085] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:17.474412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.484857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.571052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6e2c-1535-41e3-b4c5-99e96b85fb0a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.574014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a2a87-b3d2-40cc-8bb0-1bc2f7d7a2c6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.587341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.603916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.604541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.604814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.605117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.607358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.607954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.608289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.608526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.609265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:17.609562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.610960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.615692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:17.620305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:17.621341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 552/1086] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:17.622193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.628582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 535/1087] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:17.629776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.692502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.721838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ce1d2-2ca1-48bd-9aec-f64a35260aa7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.724906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa89566-571b-4956-8724-2cb82c0825b8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.754597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.755208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.755478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.755764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.756384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:17.756679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.758072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.758518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.759113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.759445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.759710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.760349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:17.760643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.762009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.769547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 553/1088] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:17.770577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.770846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 536/1089] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:17.775986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:17.820806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.883463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3bb4-97fe-4daf-a838-32ff484e7300 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.896020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f171cbd-ad4a-4b03-9a34-35d75ffa1b58 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:17.917840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:17.925021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.925560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.925838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.926144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.936245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:17.936876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:17.937177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:17.937441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] PATH_INFO: `/v3/users/339850be5bc04d539db674c5d3404381` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:17.938571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] RBAC: Authorizing `identity:get_user(user_id=339850be5bc04d539db674c5d3404381)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:17.939986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:17.941584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 537/1090] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/users/339850be5bc04d539db674c5d3404381 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:17.948167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.006278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.007987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.063677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a001b-8149-462c-8a37-1e8a3b3c93e4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.065252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:18.099431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.100069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.100346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.100605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.102046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f97e5bed1b54729821c709cf9e8b4b6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.103470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.105150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 538/1091] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:18.110416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 554/1092] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:18.111089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.116022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.146332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:18.212367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a462-909c-4ecc-a8af-384a51844ff4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.214432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4714-a28b-4f47-a248-474dd3ea48df None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.244532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.245217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.245493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.245759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6/users/339850be5bc04d539db674c5d3404381/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.246693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.247305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.247573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.247670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] RBAC: Authorizing `identity:create_grant(project_id=6f97e5bed1b54729821c709cf9e8b4b6, user_id=339850be5bc04d539db674c5d3404381, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.247833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.249060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.258549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.260100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.263049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 539/1093] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:59:18 2022] PUT /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6/users/339850be5bc04d539db674c5d3404381/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:18.275689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:18.276957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 10:59:18.278089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:18.278089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 10:59:18.278089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:18.281169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 555/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 10:59:18.283182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.316711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:18.393902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bffab-c97e-4e73-ad1c-424a268b584c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.430346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.430952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.431228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.431488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.432128 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:18.432422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.433811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.445677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 540/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 10:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:18.451411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.536855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:18.552805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f3fb2-d83f-4562-a59f-b81cb04ac15c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.587070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.587688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.587956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.588223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.595028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.596467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 10:59:18.607753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:18.608658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:18.609704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 556/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 10:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:18.614921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.707783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:18.718568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62135c5d-ad87-408a-ab80-cf1a12df1bf0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.751764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.752369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.752636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.752897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.753605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:18.753899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.755709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf637-2e68-437c-8ff8-5c54c411930f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.766892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 541/1097] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 10:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:18.773296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:18.872557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b0e7-17d7-46d2-a55b-c29b01326f8f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:18.905934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:18.906524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:18.906791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:18.907050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:18.907740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] RBAC: Adding query filter params (role.id=aae24fdfd06f4f928b67ab8ed6b2f1df, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=ded8e23edf404c378eba94e917be0c8e) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:18.908036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:18.909485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2fde2-aa1d-41d4-ace7-93617a8dc861 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:18.915127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 557/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:18 2022] GET /identity/v3/role_assignments?user.id=ded8e23edf404c378eba94e917be0c8e&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=aae24fdfd06f4f928b67ab8ed6b2f1df => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:20.215129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d677a-8092-432c-b2a1-29dd94bc1699 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:20.215924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d677a-8092-432c-b2a1-29dd94bc1699 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:20.215924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d677a-8092-432c-b2a1-29dd94bc1699 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:20.218168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 542/1099] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:20.226127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:20.226534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:20.226666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:20.246143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:20.247330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:20.249356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:20.317274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 558/1100] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:20.340484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d677a-8092-432c-b2a1-29dd94bc1699 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:20.453077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d677a-8092-432c-b2a1-29dd94bc1699 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:20.487174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:20.487792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:20.488065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:20.488325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:20.499259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:20.503924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:20.505369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:20.506375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 543/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:20.513750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:20.618060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa85c9-808c-4cea-a5e5-c6757953bf2f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:20.657176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:20.657769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:20.658042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:20.658304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:20.658966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:20.659265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:20.660639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:20.665699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:20.669145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 559/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:20.675399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:20.689998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:20.781917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ec04-2137-44a0-8d89-9d84de24c782 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:20.822979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:20.823877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:20.824275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:20.824594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] PATH_INFO: `/v3/users/339850be5bc04d539db674c5d3404381` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:20.826440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] RBAC: Authorizing `identity:get_user(user_id=339850be5bc04d539db674c5d3404381)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:20.828622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:20.831138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 544/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:20 2022] GET /identity/v3/users/339850be5bc04d539db674c5d3404381 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:20.837102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:20.943634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63af1e-6da9-4ad0-872a-b327f395b70c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:20.994920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:20.995520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:20.995790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:20.996054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:21.078875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:21.082131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:21.084362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:21.188575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 560/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:21.195634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:21.285258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:21.309618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdba7a-3b6d-41f8-bd10-9231ed73ce15 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:21.343900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee9328-9dc0-4e37-9a8a-eb8ff8ededbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:21.344446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9328-9dc0-4e37-9a8a-eb8ff8ededbd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:21.344711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9328-9dc0-4e37-9a8a-eb8ff8ededbd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:21.344973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9328-9dc0-4e37-9a8a-eb8ff8ededbd None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:21.346224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee9328-9dc0-4e37-9a8a-eb8ff8ededbd None admin] RBAC: Authorizing `identity:get_project(project_id=6f97e5bed1b54729821c709cf9e8b4b6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:21.347643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee9328-9dc0-4e37-9a8a-eb8ff8ededbd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:21.349277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 545/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:21 2022] GET /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:21.358635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:21.460019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:21.463485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa899-72c9-4a57-bd14-93738bc22933 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:21.497915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:21.498524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:21.498790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:21.499050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:21.499770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6, user.id=339850be5bc04d539db674c5d3404381) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:21.500073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:21.501537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb838f-ff42-4543-98b3-a6c8b8b5d5ab None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:21.507739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 561/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:21 2022] GET /identity/v3/role_assignments?user.id=339850be5bc04d539db674c5d3404381&scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:23.477292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a0a4-dcd3-48f2-a84e-68f1af3ceb88 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:23.477842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a0a4-dcd3-48f2-a84e-68f1af3ceb88 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:23.477842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a0a4-dcd3-48f2-a84e-68f1af3ceb88 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:23.479076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 546/1107] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:23.485308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:23.485750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:23.485847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:23.506963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:23.508172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:23.580125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 562/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:23.603994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643a0a4-dcd3-48f2-a84e-68f1af3ceb88 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:23.710838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643a0a4-dcd3-48f2-a84e-68f1af3ceb88 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:23.745809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4b9c-b792-4146-bc5d-aca451c0c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:23.746388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4b9c-b792-4146-bc5d-aca451c0c153 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:23.746656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4b9c-b792-4146-bc5d-aca451c0c153 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:23.746915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4b9c-b792-4146-bc5d-aca451c0c153 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:23.748013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a4b9c-b792-4146-bc5d-aca451c0c153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:23.749597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a4b9c-b792-4146-bc5d-aca451c0c153 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:23.751158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 547/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:23.758055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:23.859991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:23.867259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf26a-8be1-4ce6-8e02-f9021258c571 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:23.903513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112061-941b-461f-9a54-db229a66657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:23.904101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112061-941b-461f-9a54-db229a66657a None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:23.904369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112061-941b-461f-9a54-db229a66657a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:23.904631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112061-941b-461f-9a54-db229a66657a None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:23.905282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112061-941b-461f-9a54-db229a66657a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:23.906715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112061-941b-461f-9a54-db229a66657a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:23.935201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 563/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:59:23 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:25.934498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27aa0c-d3d3-437f-a1dc-0daee3145a16 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:25.935448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27aa0c-d3d3-437f-a1dc-0daee3145a16 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:25.935448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27aa0c-d3d3-437f-a1dc-0daee3145a16 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:25.937579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 548/1111] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:25.942807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:25.943241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:25.943345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:25.963030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:25.964208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:26.037573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 564/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:26.060796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27aa0c-d3d3-437f-a1dc-0daee3145a16 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:26.077603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:26.166249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27aa0c-d3d3-437f-a1dc-0daee3145a16 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:26.201309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:26.202117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:26.202467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:26.202804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] PATH_INFO: `/v3/roles/137d83a6d55341aab18d66327415150f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:26.205321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] RBAC: Authorizing `identity:get_role(role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:26.207438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:26.209483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 549/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:26 2022] GET /identity/v3/roles/137d83a6d55341aab18d66327415150f => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:26.218252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:26.299792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:26.319812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199988c5-1f27-4b7d-b69d-cdf62f7b8cc4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:26.354487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:26.355096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:26.355362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:26.355629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] PATH_INFO: `/v3/users/8f85dab7d2614b79a66b5fa5ad5d0755` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:26.369291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] RBAC: Authorizing `identity:get_user(user_id=8f85dab7d2614b79a66b5fa5ad5d0755)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:26.370720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:26.372292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 565/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:26 2022] GET /identity/v3/users/8f85dab7d2614b79a66b5fa5ad5d0755 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:26.381589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:26.466896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:26.489842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af14c0-858b-482f-b6a8-6a98faffaca2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:26.525626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:26.526207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:26.526474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:26.526737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:26.604717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:26.606185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:26.688197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:26.712209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 550/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:26.721212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:26.827556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037995b4-8456-483c-a541-2f9aa2353641 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:26.862799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f41c7-aa2a-4964-8ced-d4b240ade7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:26.863405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f41c7-aa2a-4964-8ced-d4b240ade7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:26.863684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f41c7-aa2a-4964-8ced-d4b240ade7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:26.863947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f41c7-aa2a-4964-8ced-d4b240ade7a4 None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:26.865181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f41c7-aa2a-4964-8ced-d4b240ade7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f97e5bed1b54729821c709cf9e8b4b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:26.866615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f41c7-aa2a-4964-8ced-d4b240ade7a4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:26.868291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 566/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:26 2022] GET /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:26.874634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:26.991461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71f92a-4887-4dbb-a462-61ace297f67c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:27.027679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:27.028278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:27.028545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:27.028807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:27.029572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] RBAC: Adding query filter params (role.id=137d83a6d55341aab18d66327415150f, scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6, user.id=8f85dab7d2614b79a66b5fa5ad5d0755) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:27.029865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:27.031316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db9789-5551-4804-93d1-c03163c6954d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:27.036836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 551/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:26 2022] GET /identity/v3/role_assignments?user.id=8f85dab7d2614b79a66b5fa5ad5d0755&scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6&role.id=137d83a6d55341aab18d66327415150f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:28.981233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c112385-102c-4223-b5a5-eb234655e4d6 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:28.981849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c112385-102c-4223-b5a5-eb234655e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:28.981849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c112385-102c-4223-b5a5-eb234655e4d6 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:28.983128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 567/1118] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:28.989494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:28.990229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:28.990376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:29.015968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:29.017192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:29.062358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:29.095832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 552/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:29.126486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c112385-102c-4223-b5a5-eb234655e4d6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:29.136715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:29.238001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c112385-102c-4223-b5a5-eb234655e4d6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:29.273760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:29.274369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:29.274639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:29.274899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] PATH_INFO: `/v3/roles/137d83a6d55341aab18d66327415150f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:29.276268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] RBAC: Authorizing `identity:get_role(role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:29.277653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:29.278966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 568/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:29 2022] GET /identity/v3/roles/137d83a6d55341aab18d66327415150f => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:29.285065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:29.392323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ee20b-7b32-4449-885b-d9f90f730e66 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:29.428216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:29.428834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:29.429135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:29.429438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] PATH_INFO: `/v3/users/8f85dab7d2614b79a66b5fa5ad5d0755` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:29.430604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] RBAC: Authorizing `identity:get_user(user_id=8f85dab7d2614b79a66b5fa5ad5d0755)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:29.432060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:29.433663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 553/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:29 2022] GET /identity/v3/users/8f85dab7d2614b79a66b5fa5ad5d0755 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:29.442872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:29.521683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:29.548645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22f308-0f29-45a4-9793-ff592a3e737c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:29.583431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2706310-7295-4c75-afe8-5ed82f39a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:29.584032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2706310-7295-4c75-afe8-5ed82f39a8df None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:29.584301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2706310-7295-4c75-afe8-5ed82f39a8df None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:29.584562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2706310-7295-4c75-afe8-5ed82f39a8df None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:29.585781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2706310-7295-4c75-afe8-5ed82f39a8df None admin] RBAC: Authorizing `identity:get_project(project_id=6f97e5bed1b54729821c709cf9e8b4b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:29.587212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2706310-7295-4c75-afe8-5ed82f39a8df None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:29.588810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 569/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:29 2022] GET /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:29.595139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:29.645133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:29.699489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21978d42-4951-46e7-8fce-5c3574ada5ac None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:29.739923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ba397-eda3-42b0-b582-7c479485c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:29.740837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba397-eda3-42b0-b582-7c479485c212 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:29.741223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba397-eda3-42b0-b582-7c479485c212 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:29.741564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba397-eda3-42b0-b582-7c479485c212 None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6/users/8f85dab7d2614b79a66b5fa5ad5d0755/roles/137d83a6d55341aab18d66327415150f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:29.745674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ba397-eda3-42b0-b582-7c479485c212 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f97e5bed1b54729821c709cf9e8b4b6, user_id=8f85dab7d2614b79a66b5fa5ad5d0755, role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:29.747915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ba397-eda3-42b0-b582-7c479485c212 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:29.765519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 554/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:59:29 2022] PUT /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6/users/8f85dab7d2614b79a66b5fa5ad5d0755/roles/137d83a6d55341aab18d66327415150f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:59:31.721470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1774d-75b0-4af4-bf13-94ebd500a188 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:31.722381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1774d-75b0-4af4-bf13-94ebd500a188 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:31.722381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1774d-75b0-4af4-bf13-94ebd500a188 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:31.724576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 570/1124] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:31.730921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:31.731584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:31.731780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:31.760346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:31.761541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:31.837728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 555/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:31.860295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1774d-75b0-4af4-bf13-94ebd500a188 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:31.966822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1774d-75b0-4af4-bf13-94ebd500a188 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:32.003596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:32.004517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:32.004789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:32.005083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] PATH_INFO: `/v3/roles/137d83a6d55341aab18d66327415150f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:32.006538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] RBAC: Authorizing `identity:get_role(role_id=137d83a6d55341aab18d66327415150f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:32.008021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:32.009374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 571/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:31 2022] GET /identity/v3/roles/137d83a6d55341aab18d66327415150f => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:32.015329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:32.049831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:32.115962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5d58-25c5-4c4c-a70e-34719be6cabd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:32.164444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:32.165087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:32.165360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:32.165622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] PATH_INFO: `/v3/users/8f85dab7d2614b79a66b5fa5ad5d0755` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:32.166765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=8f85dab7d2614b79a66b5fa5ad5d0755)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:32.168181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:32.169780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 556/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:32 2022] GET /identity/v3/users/8f85dab7d2614b79a66b5fa5ad5d0755 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:32.175900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:32.189081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:32.278933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ea041-12ec-47b8-a4b4-639ec26495e5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:32.313811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:32.314396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:32.314664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:32.314922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:32.383750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:32.385218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:32.395798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:32.490482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 572/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:32.499613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:32.602874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff739ee-0387-4fad-a3e2-b90c3fa0dbf0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:32.604375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:32.641103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd559a07-46b9-460d-8955-c18440ca0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:32.641711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd559a07-46b9-460d-8955-c18440ca0404 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:32.641974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd559a07-46b9-460d-8955-c18440ca0404 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:32.642240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd559a07-46b9-460d-8955-c18440ca0404 None admin] PATH_INFO: `/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:32.643453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd559a07-46b9-460d-8955-c18440ca0404 None admin] RBAC: Authorizing `identity:get_project(project_id=6f97e5bed1b54729821c709cf9e8b4b6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:32.644873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd559a07-46b9-460d-8955-c18440ca0404 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:32.646504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 557/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:32 2022] GET /identity/v3/projects/6f97e5bed1b54729821c709cf9e8b4b6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:32.656340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:32.760928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73672c-c3dc-41ab-acc8-447829733f85 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:32.771525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:32.796711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:32.797333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:32.797607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:32.797873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:32.798587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] RBAC: Adding query filter params (role.id=137d83a6d55341aab18d66327415150f, scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6, user.id=8f85dab7d2614b79a66b5fa5ad5d0755) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:32.798889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:32.800325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11530e-c31a-4cc6-82ad-222e4f5aefe3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:32.806695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 573/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:32 2022] GET /identity/v3/role_assignments?user.id=8f85dab7d2614b79a66b5fa5ad5d0755&scope.project.id=6f97e5bed1b54729821c709cf9e8b4b6&role.id=137d83a6d55341aab18d66327415150f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:34.796007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901a56e-71aa-4254-8f56-9ce57d7fc40b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:34.796571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901a56e-71aa-4254-8f56-9ce57d7fc40b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:34.796571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901a56e-71aa-4254-8f56-9ce57d7fc40b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:34.797922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 558/1131] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:34.804522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:34.805285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:34.805419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:34.830155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:34.831364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:34.901157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 574/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:34.924428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901a56e-71aa-4254-8f56-9ce57d7fc40b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:35.038926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901a56e-71aa-4254-8f56-9ce57d7fc40b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:35.073976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a60e9-12fb-484b-a25d-baf202f687c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:35.074518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a60e9-12fb-484b-a25d-baf202f687c7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:35.074788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a60e9-12fb-484b-a25d-baf202f687c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:35.075054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a60e9-12fb-484b-a25d-baf202f687c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:35.076269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a60e9-12fb-484b-a25d-baf202f687c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:35.077752 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a60e9-12fb-484b-a25d-baf202f687c7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:35.079280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 559/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:35.088275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:35.187356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff660-71a2-42c3-b230-501c58a23bb7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:35.190119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:35.242501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883be1ac-bc7b-43bc-aeec-b5b41c71b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:35.243431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883be1ac-bc7b-43bc-aeec-b5b41c71b0ee None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:35.243713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883be1ac-bc7b-43bc-aeec-b5b41c71b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:35.243977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883be1ac-bc7b-43bc-aeec-b5b41c71b0ee None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:35.244621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883be1ac-bc7b-43bc-aeec-b5b41c71b0ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:35.246097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883be1ac-bc7b-43bc-aeec-b5b41c71b0ee None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:35.276627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 575/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:59:35 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:59:37.276387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9575-33eb-43c8-863b-96f17c9bf012 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:37.276944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9575-33eb-43c8-863b-96f17c9bf012 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:37.276944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9575-33eb-43c8-863b-96f17c9bf012 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:37.278995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 560/1135] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:37.287739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:37.288134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:37.288342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:37.309693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:37.310868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:37.387118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 576/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:37.415996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9575-33eb-43c8-863b-96f17c9bf012 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:37.460832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:37.522771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9575-33eb-43c8-863b-96f17c9bf012 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:37.557204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d3296-cafd-4c53-b5f1-5608eb8ecfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:37.557822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d3296-cafd-4c53-b5f1-5608eb8ecfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:37.558088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d3296-cafd-4c53-b5f1-5608eb8ecfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:37.558346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d3296-cafd-4c53-b5f1-5608eb8ecfd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:37.559449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d3296-cafd-4c53-b5f1-5608eb8ecfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:37.560867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d3296-cafd-4c53-b5f1-5608eb8ecfd4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:37.562460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 561/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 10:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:37.568777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:37.657211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:37.674603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dac907-03d6-4c3d-a27a-8507e0ce377e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:37.709304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b4e84-4d47-4c75-8462-86cfad4fb6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:37.709894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b4e84-4d47-4c75-8462-86cfad4fb6cb None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:37.710161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b4e84-4d47-4c75-8462-86cfad4fb6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:37.710420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b4e84-4d47-4c75-8462-86cfad4fb6cb None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:37.711044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b4e84-4d47-4c75-8462-86cfad4fb6cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:37.712467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b4e84-4d47-4c75-8462-86cfad4fb6cb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:37.735322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 577/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:59:37 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:39.746479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63892f9-c6fc-4e24-a8b6-bbf6cbe23d88 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:39.747041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63892f9-c6fc-4e24-a8b6-bbf6cbe23d88 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:39.747041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63892f9-c6fc-4e24-a8b6-bbf6cbe23d88 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:39.748329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 562/1139] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:39.755048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220641-d2af-492f-964e-a050182c862e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:39.755801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220641-d2af-492f-964e-a050182c862e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:39.755933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220641-d2af-492f-964e-a050182c862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:39.782043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-be220641-d2af-492f-964e-a050182c862e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:39.783234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-be220641-d2af-492f-964e-a050182c862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:39.855922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 578/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:39.879107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63892f9-c6fc-4e24-a8b6-bbf6cbe23d88 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:39.986360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63892f9-c6fc-4e24-a8b6-bbf6cbe23d88 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:39.993659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:40.022445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:40.023059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:40.023327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:40.023588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:40.033815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:40.038428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:40.039558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:40.040733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 563/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:40.045975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220641-d2af-492f-964e-a050182c862e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:40.118948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:40.153161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220641-d2af-492f-964e-a050182c862e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:40.188202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:40.188791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:40.189087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:40.189349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:40.189993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:40.190282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:40.191644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:40.199754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 579/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:40.205959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:40.320048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a284b3-6d94-4519-95b9-40d8db28d00a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:40.354656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:40.355268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:40.355539 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:40.355807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] PATH_INFO: `/v3/users/f91e2a31dd094d2fb625487d9d7a88ce` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:40.369815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] RBAC: Authorizing `identity:get_user(user_id=f91e2a31dd094d2fb625487d9d7a88ce)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:40.371239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:40.372819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 564/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:40 2022] GET /identity/v3/users/f91e2a31dd094d2fb625487d9d7a88ce => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:40.382532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:40.503433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568952b1-ca44-4612-91f5-12e5cab279f4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:40.542026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:40.542607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:40.542868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:40.543126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:40.545593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:40.611997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:40.613388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:40.713267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 580/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:40.719640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:40.749469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:40.824662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019541b3-fb57-49e1-8f4c-45207be71115 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:40.859126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ecd97-f1f8-4d67-ac1f-1be0ca94fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:40.859734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ecd97-f1f8-4d67-ac1f-1be0ca94fb93 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:40.860004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ecd97-f1f8-4d67-ac1f-1be0ca94fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:40.860248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ecd97-f1f8-4d67-ac1f-1be0ca94fb93 None admin] PATH_INFO: `/v3/projects/9a2c160de8ce4308b6548df9b7c31326` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:40.861399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ecd97-f1f8-4d67-ac1f-1be0ca94fb93 None admin] RBAC: Authorizing `identity:get_project(project_id=9a2c160de8ce4308b6548df9b7c31326)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:40.862853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ecd97-f1f8-4d67-ac1f-1be0ca94fb93 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:40.864391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 565/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:40 2022] GET /identity/v3/projects/9a2c160de8ce4308b6548df9b7c31326 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:40.871484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:40.909505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:40.986743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43cf29-d08d-457d-8cbc-c1d3a9887d7c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:41.021667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:41.022244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:41.022512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:41.022768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:41.023462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=9a2c160de8ce4308b6548df9b7c31326, user.id=f91e2a31dd094d2fb625487d9d7a88ce) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:41.023758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:41.025225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a909be-88a3-49a8-8a6f-3652695a0c5b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:41.030473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 581/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:40 2022] GET /identity/v3/role_assignments?user.id=f91e2a31dd094d2fb625487d9d7a88ce&scope.project.id=9a2c160de8ce4308b6548df9b7c31326&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:42.947002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f391be-13e9-4711-b945-ee2e8b38ece1 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:42.947607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f391be-13e9-4711-b945-ee2e8b38ece1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:42.947607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f391be-13e9-4711-b945-ee2e8b38ece1 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:42.948846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 566/1147] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:42.955295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:42.955972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:42.956115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:42.983156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:42.984341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:43.058685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 582/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:43.080791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f391be-13e9-4711-b945-ee2e8b38ece1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:43.177337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:43.188532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f391be-13e9-4711-b945-ee2e8b38ece1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:43.223109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:43.223665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:43.223934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:43.224201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:43.234663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:43.239324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:43.240402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:43.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 567/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:43.246756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:43.279667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:43.350750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadabdb7-6a3d-4bc9-b35c-b15483a3c24b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:43.386201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:43.386788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:43.387063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:43.387325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:43.387976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:43.388271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:43.389662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:43.397786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 583/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:43.407323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:43.519903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce8c8-4e23-46aa-b687-87eb7c1268e6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:43.554765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:43.555364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:43.555658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:43.555945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] PATH_INFO: `/v3/users/f91e2a31dd094d2fb625487d9d7a88ce` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:43.557190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] RBAC: Authorizing `identity:get_user(user_id=f91e2a31dd094d2fb625487d9d7a88ce)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:43.558595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:43.560151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 568/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:43 2022] GET /identity/v3/users/f91e2a31dd094d2fb625487d9d7a88ce => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:43.566820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:43.675351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:43.691362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78ad2-2ac7-482a-9510-5ae882d894f4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:43.729095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083f69-4533-4f0f-9444-c1d66c49bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:43.729733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083f69-4533-4f0f-9444-c1d66c49bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:43.730010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083f69-4533-4f0f-9444-c1d66c49bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:43.730243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083f69-4533-4f0f-9444-c1d66c49bbc4 None admin] PATH_INFO: `/v3/projects/9a2c160de8ce4308b6548df9b7c31326` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:43.731466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083f69-4533-4f0f-9444-c1d66c49bbc4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a2c160de8ce4308b6548df9b7c31326)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:43.732933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083f69-4533-4f0f-9444-c1d66c49bbc4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:43.734587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 584/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:43 2022] GET /identity/v3/projects/9a2c160de8ce4308b6548df9b7c31326 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:43.740814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:43.770038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:43.847966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03af3-57c2-45c4-b967-87f87a1db50f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:43.883949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028d804-4ccc-4be9-b3c3-333d6da81068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:43.884582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028d804-4ccc-4be9-b3c3-333d6da81068 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:43.884849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028d804-4ccc-4be9-b3c3-333d6da81068 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:43.885143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028d804-4ccc-4be9-b3c3-333d6da81068 None admin] PATH_INFO: `/v3/projects/9a2c160de8ce4308b6548df9b7c31326/users/f91e2a31dd094d2fb625487d9d7a88ce/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:43.887083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028d804-4ccc-4be9-b3c3-333d6da81068 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2c160de8ce4308b6548df9b7c31326, user_id=f91e2a31dd094d2fb625487d9d7a88ce, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:43.888713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028d804-4ccc-4be9-b3c3-333d6da81068 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:43.903360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 569/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 10:59:43 2022] PUT /identity/v3/projects/9a2c160de8ce4308b6548df9b7c31326/users/f91e2a31dd094d2fb625487d9d7a88ce/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:59:45.870934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931723-37e0-40f5-afc6-5305dd5ebdd9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:45.871795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931723-37e0-40f5-afc6-5305dd5ebdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:45.871795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931723-37e0-40f5-afc6-5305dd5ebdd9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:45.874007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 585/1154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:45.880672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:45.881156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:45.881250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:45.906683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:45.907872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:45.982820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 570/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:46.012871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931723-37e0-40f5-afc6-5305dd5ebdd9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:46.122570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931723-37e0-40f5-afc6-5305dd5ebdd9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:46.157835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:46.158449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:46.158720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:46.158985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:46.169570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:46.174225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:46.175285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:46.176254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 586/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:46.181712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:46.194380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:46.295348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88772b7-ee53-4ae5-9710-fa325f640237 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:46.331931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:46.332531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:46.332806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:46.333085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:46.333738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:46.334025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:46.335377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:46.344053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 571/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:59:46.350398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:46.373173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:46.471729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d35f2e-75bd-42ea-a8a2-fd503b6df9d6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:46.506498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:46.507109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:46.507378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:46.507645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] PATH_INFO: `/v3/users/f91e2a31dd094d2fb625487d9d7a88ce` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:46.508889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] RBAC: Authorizing `identity:get_user(user_id=f91e2a31dd094d2fb625487d9d7a88ce)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:46.510348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:46.511922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 587/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:46 2022] GET /identity/v3/users/f91e2a31dd094d2fb625487d9d7a88ce => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:46.521608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:46.597019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:46.627042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a553696-094d-41e8-98b9-b8665ddd864d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:46.662587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:46.663186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:46.663457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:46.663715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:46.736179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:46.737653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:46.810574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:46.840866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 572/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:46.847343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:46.940749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:46.956602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315db51-6a16-43b2-a297-b906582376e7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:46.990612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d26f1-3200-41c9-b444-5331461d6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:46.991226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d26f1-3200-41c9-b444-5331461d6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:46.991503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d26f1-3200-41c9-b444-5331461d6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:46.991766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d26f1-3200-41c9-b444-5331461d6ea5 None admin] PATH_INFO: `/v3/projects/9a2c160de8ce4308b6548df9b7c31326` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:46.992879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d26f1-3200-41c9-b444-5331461d6ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=9a2c160de8ce4308b6548df9b7c31326)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:46.994796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d26f1-3200-41c9-b444-5331461d6ea5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:46.996404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 588/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 10:59:46 2022] GET /identity/v3/projects/9a2c160de8ce4308b6548df9b7c31326 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:47.002738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:47.127404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e61a-e260-4015-86b3-046aa8ff3bc5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:47.171059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:47.171870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:47.172214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:47.172561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:47.173685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=9a2c160de8ce4308b6548df9b7c31326, user.id=f91e2a31dd094d2fb625487d9d7a88ce) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:47.174097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:47.176334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baaeee-49aa-406a-8435-ff848daab70f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:47.184076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 573/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 10:59:47 2022] GET /identity/v3/role_assignments?user.id=f91e2a31dd094d2fb625487d9d7a88ce&scope.project.id=9a2c160de8ce4308b6548df9b7c31326&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:49.171988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9702d2-5331-476e-9c2b-a87a4c1727e1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:49.172490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9702d2-5331-476e-9c2b-a87a4c1727e1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:49.172490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9702d2-5331-476e-9c2b-a87a4c1727e1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:49.173909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 589/1162] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:49.180187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:49.180940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:49.181129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:49.206057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:49.207245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:49.241874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:49.287357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 574/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:49.310416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9702d2-5331-476e-9c2b-a87a4c1727e1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:49.423392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9702d2-5331-476e-9c2b-a87a4c1727e1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:49.459028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:49.459613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:49.459888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:49.460155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:49.484130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:49.531728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:49.533195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:49.635792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 590/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 10:59:49.645422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:49.748233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4e98b-f279-4553-9cec-b7a515c06ab2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:49.784362 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:49.784967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:49.785270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:49.785531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:49.792353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:49.793817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-af751ab6-c41f-4924-aefc-973077583b86 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:49.805200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:49.806374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 10:59:49.807430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 10:59:49.809173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 575/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 10:59:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:49.812328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:49.867250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:49.912639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d34d4-572e-414a-b72b-8fba56bcd2e9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:49.949195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:49.950090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:49.950489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:49.950864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:49.951849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:49.952293 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:49.954534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d54f8-de5d-4b85-b355-9651057272d5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:49.966997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 591/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 10 10:59:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:51.903022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59ecc-17d5-4505-bc0a-a4b5f4243c99 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:51.903589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59ecc-17d5-4505-bc0a-a4b5f4243c99 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:51.903589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59ecc-17d5-4505-bc0a-a4b5f4243c99 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:51.904884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 576/1167] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:51.911209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62436073-bdaf-4bba-bf31-781865afd6c5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:51.911973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62436073-bdaf-4bba-bf31-781865afd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:51.912147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62436073-bdaf-4bba-bf31-781865afd6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:51.931623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-62436073-bdaf-4bba-bf31-781865afd6c5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:51.932827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-62436073-bdaf-4bba-bf31-781865afd6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:52.018583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 592/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:52.049024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b59ecc-17d5-4505-bc0a-a4b5f4243c99 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:52.080815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:52.163534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b59ecc-17d5-4505-bc0a-a4b5f4243c99 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:52.198033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304bab-bf93-4bc1-a9ec-1a78a6091267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:52.198624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304bab-bf93-4bc1-a9ec-1a78a6091267 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:52.198891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304bab-bf93-4bc1-a9ec-1a78a6091267 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:52.199157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304bab-bf93-4bc1-a9ec-1a78a6091267 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:52.199804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304bab-bf93-4bc1-a9ec-1a78a6091267 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:52.201205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304bab-bf93-4bc1-a9ec-1a78a6091267 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:52.220716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 577/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Wed Aug 10 10:59:52 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:54.202866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b9224-1a66-41a1-9710-d24a658df28c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:54.203728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b9224-1a66-41a1-9710-d24a658df28c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:54.203728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b9224-1a66-41a1-9710-d24a658df28c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:54.205926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 593/1170] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:54.212161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:54.212604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:54.212695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:54.236345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:54.237560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:54.313377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 578/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:54.336677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b9224-1a66-41a1-9710-d24a658df28c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:54.390799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:54.446996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b9224-1a66-41a1-9710-d24a658df28c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:54.484193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004e284-4023-4854-ba5f-958fa508bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:54.484808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004e284-4023-4854-ba5f-958fa508bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:54.485110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004e284-4023-4854-ba5f-958fa508bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:54.485373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004e284-4023-4854-ba5f-958fa508bb5b None admin] PATH_INFO: `/v3/domains/8e941f3eaa27454389f117d3c4afaa68` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:54.496313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004e284-4023-4854-ba5f-958fa508bb5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e941f3eaa27454389f117d3c4afaa68)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:54.497769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004e284-4023-4854-ba5f-958fa508bb5b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:54.499334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 594/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Aug 10 10:59:54 2022] GET /identity/v3/domains/8e941f3eaa27454389f117d3c4afaa68 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:54.505662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:54.523484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:54.611039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9b4ae-2bfc-4799-898c-2340177df063 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:54.646056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24e0e4-da0f-4757-b634-2d0cd9ca3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:54.646579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e0e4-da0f-4757-b634-2d0cd9ca3782 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:54.646848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e0e4-da0f-4757-b634-2d0cd9ca3782 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:54.647112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e0e4-da0f-4757-b634-2d0cd9ca3782 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:54.647742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e0e4-da0f-4757-b634-2d0cd9ca3782 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:54.649289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e0e4-da0f-4757-b634-2d0cd9ca3782 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:54.681744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 579/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 10:59:54 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:56.676463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52090-7cce-43d4-8b28-512cdd40a955 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:56.677369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52090-7cce-43d4-8b28-512cdd40a955 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:56.677369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52090-7cce-43d4-8b28-512cdd40a955 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:56.680030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 595/1174] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:56.685595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:56.686025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:56.686115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:56.704434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:56.705645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:56.768847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:56.775347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 580/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:56.800129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52090-7cce-43d4-8b28-512cdd40a955 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:56.909229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52090-7cce-43d4-8b28-512cdd40a955 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:56.917840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:56.945741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb45e4a-8d83-4f31-86f5-ff244319d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:56.946333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb45e4a-8d83-4f31-86f5-ff244319d534 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:56.946595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb45e4a-8d83-4f31-86f5-ff244319d534 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:56.946864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb45e4a-8d83-4f31-86f5-ff244319d534 None admin] PATH_INFO: `/v3/domains/8e941f3eaa27454389f117d3c4afaa68` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:56.947978 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb45e4a-8d83-4f31-86f5-ff244319d534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e941f3eaa27454389f117d3c4afaa68)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:56.949440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb45e4a-8d83-4f31-86f5-ff244319d534 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:56.951073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 596/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Aug 10 10:59:56 2022] GET /identity/v3/domains/8e941f3eaa27454389f117d3c4afaa68 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:56.957155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:57.062787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80112e1-2631-4977-a32f-3532ba6ae6c3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:57.097473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb7261-7618-44d7-b95e-237df10371bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:57.098064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7261-7618-44d7-b95e-237df10371bd None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:57.098335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7261-7618-44d7-b95e-237df10371bd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:57.098598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7261-7618-44d7-b95e-237df10371bd None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:57.099229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7261-7618-44d7-b95e-237df10371bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:57.100651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7261-7618-44d7-b95e-237df10371bd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:57.125156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 581/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 10:59:56 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:59:59.099219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b2c26-0fbf-416c-809d-339330aae434 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:59.099804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b2c26-0fbf-416c-809d-339330aae434 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:59.099804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b2c26-0fbf-416c-809d-339330aae434 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:59.101100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 597/1178] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 10:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:59:59.107444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:59.108141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:59.108307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:59.136535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:59:59.137767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:59:59.189562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:59.209487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 582/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 10:59:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 10:59:59.233471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b2c26-0fbf-416c-809d-339330aae434 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:59.348678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b2c26-0fbf-416c-809d-339330aae434 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:59.383394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:59.383989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:59.384264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:59.384527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:59.395024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 10:59:59.399687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 10:59:59.400746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 10:59:59.402113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 598/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 10:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 10:59:59.409976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:59.507066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3e1d-8e3e-4867-b233-ba0e5321e727 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:59.547495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:59.548098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:59.548374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:59.548637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:59.549320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:59:59.549615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:59.550968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:59.559807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 583/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 10:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:59.566059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:59.605773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:59.671956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f989c6-6c4c-452f-8295-6d7ef9aacc50 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:59.708238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:59.709158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:59.709505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:59.709845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] PATH_INFO: `/v3/users/cdf6a66be14942958de88697685e00d8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:59.726274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf6a66be14942958de88697685e00d8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:59.727693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:59:59.729296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 599/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 10:59:59 2022] GET /identity/v3/users/cdf6a66be14942958de88697685e00d8 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:59:59.735801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:59:59.785627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:59:59.855420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2893-825d-4d85-9627-e2b156e7cb62 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:59:59.891213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:59:59.891817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:59:59.892090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:59:59.892350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:59:59.960407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:59:59.961834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:00.006346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:00.064325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 584/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 10:59:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:00:00.073215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:00.182915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:00.190585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396357-42d2-46cb-882e-d96b80670036 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:00.225661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67fa2-5913-431f-afa9-12333724b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:00.226215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67fa2-5913-431f-afa9-12333724b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:00.226492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67fa2-5913-431f-afa9-12333724b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:00.226754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67fa2-5913-431f-afa9-12333724b1b1 None admin] PATH_INFO: `/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:00.227979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67fa2-5913-431f-afa9-12333724b1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=7b269cfe8bf749eca363a2ee0fc5bf8f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:00.229521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67fa2-5913-431f-afa9-12333724b1b1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:00.231197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 600/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 11:00:00 2022] GET /identity/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:00.240518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:00.347106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b807-86dd-40ef-898e-b26eceadee64 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:00.382192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:00.382778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:00.383046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:00.383305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:00.384039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=7b269cfe8bf749eca363a2ee0fc5bf8f, user.id=cdf6a66be14942958de88697685e00d8) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:00:00.384348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:00.385782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d418-6405-4f5a-94f7-9b2efd5e253f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:00.391175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 585/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 11:00:00 2022] GET /identity/v3/role_assignments?user.id=cdf6a66be14942958de88697685e00d8&scope.project.id=7b269cfe8bf749eca363a2ee0fc5bf8f&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:02.355546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b862b6-e0cb-4c57-aff2-e45a0da6b9eb None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:02.356102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b862b6-e0cb-4c57-aff2-e45a0da6b9eb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:02.356102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b862b6-e0cb-4c57-aff2-e45a0da6b9eb None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:02.357462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 601/1186] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:00:02.363709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:02.364441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:02.364566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:02.390672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:00:02.391776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:00:02.394683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:02.461517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 586/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:00:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:00:02.483760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b862b6-e0cb-4c57-aff2-e45a0da6b9eb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:02.603279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b862b6-e0cb-4c57-aff2-e45a0da6b9eb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:02.638661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:02.639274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:02.639541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:02.639806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:02.650747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:00:02.655325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:00:02.656405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:00:02.657444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 602/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 11:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:00:02.663392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:02.773328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c5971-2662-4e12-9045-a8a61feea77d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:02.808482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:02.809110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:02.809378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:02.809636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:02.810286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:00:02.810579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:02.811940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:02.820876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 587/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 11:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:02.826905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:02.853413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:02.934982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8974e-2d1d-4b6b-afa6-c7f760dcc553 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:02.969937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:02.970550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:02.970824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:02.971084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] PATH_INFO: `/v3/users/cdf6a66be14942958de88697685e00d8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:02.972314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf6a66be14942958de88697685e00d8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:02.973780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:02.975361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 603/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 11:00:02 2022] GET /identity/v3/users/cdf6a66be14942958de88697685e00d8 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:02.981670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:02.984848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:03.086470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845bbe9-63b7-45ab-84db-46aabe5d0504 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:03.121214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc3e2-61c4-4f34-ad99-b0496ef35054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:03.121846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc3e2-61c4-4f34-ad99-b0496ef35054 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:03.122116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc3e2-61c4-4f34-ad99-b0496ef35054 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:03.122381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc3e2-61c4-4f34-ad99-b0496ef35054 None admin] PATH_INFO: `/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:03.123582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fc3e2-61c4-4f34-ad99-b0496ef35054 None admin] RBAC: Authorizing `identity:get_project(project_id=7b269cfe8bf749eca363a2ee0fc5bf8f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:03.125025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fc3e2-61c4-4f34-ad99-b0496ef35054 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:03.126877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 588/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 11:00:02 2022] GET /identity/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:00:03.133297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:03.229900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:03.240230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee556a6-785c-4dcb-b019-603c73ac4661 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:03.275620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885f280-af81-4500-bf8e-4a30f6d3caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:03.276256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f280-af81-4500-bf8e-4a30f6d3caec None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:03.276523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f280-af81-4500-bf8e-4a30f6d3caec None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:03.276784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f280-af81-4500-bf8e-4a30f6d3caec None admin] PATH_INFO: `/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f/users/cdf6a66be14942958de88697685e00d8/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:03.278924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885f280-af81-4500-bf8e-4a30f6d3caec None admin] RBAC: Authorizing `identity:create_grant(project_id=7b269cfe8bf749eca363a2ee0fc5bf8f, user_id=cdf6a66be14942958de88697685e00d8, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:03.280367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885f280-af81-4500-bf8e-4a30f6d3caec None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:03.295934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 604/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 11:00:03 2022] PUT /identity/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f/users/cdf6a66be14942958de88697685e00d8/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:00:05.235876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50614-ded5-4e0b-9b81-b935d490719d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:05.236445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50614-ded5-4e0b-9b81-b935d490719d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:05.236445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50614-ded5-4e0b-9b81-b935d490719d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:05.237775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 589/1193] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:00:05.243198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:05.243630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:05.243726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:05.263486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:00:05.264649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:00:05.332254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 605/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:00:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:00:05.356171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50614-ded5-4e0b-9b81-b935d490719d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:05.444404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:05.480068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50614-ded5-4e0b-9b81-b935d490719d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:05.516781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:05.517424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:05.517695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:05.517956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:05.529127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:00:05.533764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:00:05.534889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:00:05.535925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:00:05.537156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 590/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 11:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:00:05.540810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:05.621601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:05.652831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c9f80-a3fd-4d28-bd5a-373501a1a243 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:05.688232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e592-a287-4133-933c-007b0f57588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:05.688836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e592-a287-4133-933c-007b0f57588f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:05.689145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e592-a287-4133-933c-007b0f57588f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:05.689413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e592-a287-4133-933c-007b0f57588f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:05.690076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e592-a287-4133-933c-007b0f57588f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:00:05.690376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e592-a287-4133-933c-007b0f57588f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:05.691750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e592-a287-4133-933c-007b0f57588f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:05.700156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 606/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 11:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:05.705890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:05.809386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb74f56-de2a-49f1-ba6b-34a37fc1ac8e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:05.841748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:05.852308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:05.852943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:05.853254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:05.853521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] PATH_INFO: `/v3/users/cdf6a66be14942958de88697685e00d8` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:05.854669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf6a66be14942958de88697685e00d8)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:05.856087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:05.857749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 591/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 10 11:00:05 2022] GET /identity/v3/users/cdf6a66be14942958de88697685e00d8 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:05.863569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e592-a287-4133-933c-007b0f57588f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:05.969005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e592-a287-4133-933c-007b0f57588f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:06.002511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:06.003091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:06.003713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:06.003974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:06.015958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:06.077744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:06.079202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:06.187043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 607/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 11:00:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:00:06.195929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:06.313194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33862923-acad-4fc7-9996-5b980af01594 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:06.347886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d10f12-653b-489e-82ff-a6fbd8322464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:06.348494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10f12-653b-489e-82ff-a6fbd8322464 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:06.348761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10f12-653b-489e-82ff-a6fbd8322464 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:06.349019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10f12-653b-489e-82ff-a6fbd8322464 None admin] PATH_INFO: `/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:06.350180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d10f12-653b-489e-82ff-a6fbd8322464 None admin] RBAC: Authorizing `identity:get_project(project_id=7b269cfe8bf749eca363a2ee0fc5bf8f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:06.351595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d10f12-653b-489e-82ff-a6fbd8322464 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:06.353269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 592/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 10 11:00:06 2022] GET /identity/v3/projects/7b269cfe8bf749eca363a2ee0fc5bf8f => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:00:06.360338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:00:06.409824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:06.466960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d7cd-4698-4f4b-90db-4eb79fabc5e2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:00:06.501934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:00:06.502519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:00:06.502789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:00:06.503049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:00:06.504124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=7b269cfe8bf749eca363a2ee0fc5bf8f, user.id=cdf6a66be14942958de88697685e00d8) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:00:06.504419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:00:06.505876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859124c-bd7e-4aa4-b41b-0b713232827d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:00:06.511700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 608/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 11:00:06 2022] GET /identity/v3/role_assignments?user.id=cdf6a66be14942958de88697685e00d8&scope.project.id=7b269cfe8bf749eca363a2ee0fc5bf8f&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:00:16.342934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=67 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:00:16.509243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=47 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:00.678852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfd98a-d8eb-4a87-8b30-b6de737e8c67 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:00.679786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfd98a-d8eb-4a87-8b30-b6de737e8c67 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:00.679786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfd98a-d8eb-4a87-8b30-b6de737e8c67 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:00.680722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 593/1201] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:00.686405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:00.686906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:00.686906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:00.712708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:00.713929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:00.794265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 609/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:00.821535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfd98a-d8eb-4a87-8b30-b6de737e8c67 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:00.951455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfd98a-d8eb-4a87-8b30-b6de737e8c67 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:00.994225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:00.995204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:00.995477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:00.995844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:01.013072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:01.015168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:01.035827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:01.037108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:01.038127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:01.038127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:01.038127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:01.038127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 594/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:01.043592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:01.198172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde656-cde4-472b-b09b-b56d76ad9155 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:01.231624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:01.238875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:01.239591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:01.242987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:01.243266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:01.244043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:01.244372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:01.245784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ea2a8-fbe7-4f99-9cdc-9d94df995bac None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:01.259010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 610/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:01.265440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:01.325707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:01.395831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88539b-5a4f-4569-acb7-53ff8d6f70af None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:01.435152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced4893-ea34-4a90-9ab3-a09422a9ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:01.435835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced4893-ea34-4a90-9ab3-a09422a9ae3a None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:01.436161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced4893-ea34-4a90-9ab3-a09422a9ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:01.436532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced4893-ea34-4a90-9ab3-a09422a9ae3a None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:01.437264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced4893-ea34-4a90-9ab3-a09422a9ae3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:01.438895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced4893-ea34-4a90-9ab3-a09422a9ae3a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:01.477020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 595/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 10 11:01:01 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:01:03.673227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cea8d6-7414-4f7d-a5a8-f52253d7bf5d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:03.673925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cea8d6-7414-4f7d-a5a8-f52253d7bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:03.673925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cea8d6-7414-4f7d-a5a8-f52253d7bf5d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:03.675098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 611/1206] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:03.681180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:03.681679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:03.681777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:03.703883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:03.705236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:03.783877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 596/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:01:03.807071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cea8d6-7414-4f7d-a5a8-f52253d7bf5d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:03.916254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cea8d6-7414-4f7d-a5a8-f52253d7bf5d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:03.955674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:03.956306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:03.956654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:03.956992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:03.968389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:01:03.973098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:03.974256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:01:03.975355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:03.981201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 612/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 11:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:03.982764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:04.030722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:04.102665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfa55c-8fc7-4867-989e-7e8c186d6e39 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:04.151306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:04.151917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:04.152183 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:04.152447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:04.153133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:04.153423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:04.155890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:04.163401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 597/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 11:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:04.169414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:04.234148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:04.300095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e2106-7566-486d-9edc-463248455b9f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:04.338311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:04.339007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:04.339342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:04.339607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:04.351457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:04.353378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:04.369166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:04.370382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:04.371533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:04.371533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:04.371533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:04.375209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 613/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:04.376212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:04.489573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:04.492789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6c052-2db3-4ee1-8dba-a1c38d79736f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:04.529176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:04.529795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:04.530066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:04.530332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:04.530972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:04.531280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:04.532640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:04.545101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 598/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:01:04.551079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:04.672058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bec841-e452-4b4d-8e0f-6aa73e3da6e3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:04.673857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:04.711435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:04.712362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:04.712710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:04.713062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:04.722017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:04.723470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:01:04.736278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:04.737666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:04.738717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 614/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:04.744037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:04.887584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2214cd-c807-41a2-99aa-2558d15fad43 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:04.939467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:04.940365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:04.940642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:04.940909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:04.941682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:04.941986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:04.943427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:04.970709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 599/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 10 11:01:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:04.976908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:05.118007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c018-e6df-4602-ab7b-16e423430cbd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:05.163843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:05.164548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:05.164883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:05.165183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:05.199352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:05.253114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:05.254835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:05.380854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 615/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 11:01:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 11:01:05.383160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:05.405333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:05.501753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab64f-50d3-47c9-b020-1bc066c34f43 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:05.546970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:05.547721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:05.547994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:05.548259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:05.563778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:05.565661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:05.581636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:05.582907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:05.583841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:05.583841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:05.583841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:05.583841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 600/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:05.589333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:05.674565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:05.721407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f349e-d6ad-4427-ad25-bc29793b9bf0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:05.767963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:05.768849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:05.769179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:05.769532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:05.770424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:05.770825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:05.772661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:05.788871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 616/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:05.795098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:05.868388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:05.902952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a473-22fd-4646-9857-fa86f771ede3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:05.942604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:05.943254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:05.943546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:05.943808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:05.953423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:05.954954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:01:05.968045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:05.969276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:05.975467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 601/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 11:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:05.976324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:06.089093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a26f9-b6cb-4f4a-b947-638e2681d034 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:06.119976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:06.133558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:06.134358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:06.134633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:06.134901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:06.135624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:06.135988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:06.137568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135afe8-bb5d-42ab-9ad6-3ab20b445dcf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:06.151469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 617/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 11:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:06.157954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:06.262866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e738dc-52f9-4dd6-91ba-01494ce7b011 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:06.296557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:06.304717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:06.305084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:06.305541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:06.305883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:06.306905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=6fd9a24c27d14095b4a7d1cbd538d34c) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:06.307334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:06.309238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a9ca-f56e-46ed-b016-174ce943585c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:06.324087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 602/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 11:01:06 2022] GET /identity/v3/role_assignments?user.id=6fd9a24c27d14095b4a7d1cbd538d34c&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:01:08.296972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc39f-b943-4acd-939a-778f2de6fd39 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:08.297576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc39f-b943-4acd-939a-778f2de6fd39 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:08.297576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc39f-b943-4acd-939a-778f2de6fd39 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:08.298874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 618/1220] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:08.304173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:08.304718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:08.304718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:08.322587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:08.323763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:08.390434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 603/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:08.413291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc39f-b943-4acd-939a-778f2de6fd39 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:08.524350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc39f-b943-4acd-939a-778f2de6fd39 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:08.559429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:08.560059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:08.560343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:08.560610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:08.570740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:01:08.575377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:08.581701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:08.582985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 619/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 11:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:08.583845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:08.685350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c99dc-f962-46b4-81bb-4d3f53693a7b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:08.710722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:08.724280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:08.724968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:08.725267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:08.725532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:08.726276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:08.726571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:08.728117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:08.736439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 604/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 11:01:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:08.742814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:08.800614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:08.859370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4838-136a-45e1-8bb7-b82c674be9f9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:08.894520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:08.895147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:08.895419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:08.895679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:08.906086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:08.907749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:08.923385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:08.924504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:08.930912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:08.930912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:08.930912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:08.930912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 620/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:08.931377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:09.040488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740528de-e015-4e2f-848a-3ee4dd2f7dd4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:09.086759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:09.087519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:09.087852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:09.088181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:09.089165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:09.089685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:09.091439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:09.111580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 605/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:09.112916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:09.225909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:09.233272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4d21f-ebbf-4923-bbc7-1449055f27eb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:09.269104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:09.269877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:09.270340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:09.270624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:09.279584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:09.281152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:01:09.292790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:09.301235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:09.302382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 621/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:09.303017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:09.348252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:09.423494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959fd3b-b320-41c1-a467-826fe3e21269 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:09.466066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:09.466680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:09.467092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:09.467368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:09.468102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:09.468403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:09.470273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:09.490893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 606/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 10 11:01:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:09.497658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:09.601275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48e29-1f42-4ec7-b09f-0baadac61f56 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:09.636483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:09.637179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:09.637452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:09.637711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:09.648313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:09.649802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:09.665859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:09.667131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:09.668053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:09.668053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:09.668053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:09.668053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 622/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:09.673526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:09.783996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcdcca-7630-4a78-b9e7-e0c6753d8caa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:09.786767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:09.825005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:09.825644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:09.825919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:09.826184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:09.826824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:09.827122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:09.828485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:09.840136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 607/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:09.846307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:09.856347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:09.957432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63e0c6-f6be-402a-970d-2c918256eae7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:09.992493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:09.993163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:09.993485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:09.993749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:10.000747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:10.002216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:01:10.014150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:10.015394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:10.016346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 623/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 11:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:10.021417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:10.135272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26fb3-8356-48f1-a856-b90f7cd3e7ae None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:10.173240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:10.173911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:10.174212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:10.174501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:10.175285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:10.175637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:10.177556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6ed5-9dcc-4759-8327-4c887de62987 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:10.191933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 608/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 11:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:01:10.198229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:10.266204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:10.303670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d499a5-ae2f-4bce-b537-c616a7afdb06 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:10.338494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b171b0-2622-40a9-8cc5-37a52261902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:10.339152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b171b0-2622-40a9-8cc5-37a52261902a None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:10.339424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b171b0-2622-40a9-8cc5-37a52261902a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:10.339695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b171b0-2622-40a9-8cc5-37a52261902a None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/6fd9a24c27d14095b4a7d1cbd538d34c/roles/30979a8d55dd412bac2e5bbccf488d23` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:10.355930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b171b0-2622-40a9-8cc5-37a52261902a None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=6fd9a24c27d14095b4a7d1cbd538d34c, role_id=30979a8d55dd412bac2e5bbccf488d23)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:10.357477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b171b0-2622-40a9-8cc5-37a52261902a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:10.370478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 624/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 11:01:10 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/6fd9a24c27d14095b4a7d1cbd538d34c/roles/30979a8d55dd412bac2e5bbccf488d23 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:01:12.344649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f50c9-1fb5-41c2-9ef6-a02c2cc38c1d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:12.345297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f50c9-1fb5-41c2-9ef6-a02c2cc38c1d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:12.345388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f50c9-1fb5-41c2-9ef6-a02c2cc38c1d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:12.346699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 609/1233] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:12.351993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:12.352421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:12.352559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:12.370740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:12.372033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:12.446078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 625/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:01:12.469328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f50c9-1fb5-41c2-9ef6-a02c2cc38c1d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:12.498650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:12.583072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f50c9-1fb5-41c2-9ef6-a02c2cc38c1d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:12.617856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:12.618510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:12.618780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:12.619033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:12.631756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:01:12.637471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:12.638533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:12.639373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 610/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 10 11:01:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:12.645392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:12.695565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:12.777587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff7c97-ae40-481d-a5c1-3f05928b187b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:12.817064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:12.817665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:12.817936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:12.818195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:12.818848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:12.819137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:12.820490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:12.834644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 626/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 10 11:01:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:12.836483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:12.933895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:12.950492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5294-f431-4bf7-a9a8-e2e1aa7a321c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:12.985919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:12.986545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:12.986813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:12.987079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:12.998006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:12.999446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:13.014470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:13.015582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:13.016501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:13.016501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:13.016501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:13.016501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 611/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:13.021611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:13.133501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126768-4c8d-45fb-99a0-32ecb296c70c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:13.142700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:13.169818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:13.170425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:13.170698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:13.170969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:13.171609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:13.171957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:13.173886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:13.189357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 627/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:13.195492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:13.298907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371f46-351a-4948-8288-38bd9a875552 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:13.334415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:13.335082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:13.335366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:13.335639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:13.338419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:13.344107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:13.345754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:01:13.357102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:13.358164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:13.359246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 612/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:13.365389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:13.472504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410053c5-57a7-47be-b437-3f095a3ae27f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:13.510877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:13.511618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:13.512415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:13.512771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:13.513547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:13.513852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:13.515309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:13.533728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 628/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 10 11:01:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:13.541891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:13.654047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5fd1-671a-4889-9fad-d16f7544270b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:13.688348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:13.688946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:13.689276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:13.689511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:13.754210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:13.761364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:13.762795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:13.871756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 613/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 11:01:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:01:13.878465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:13.907343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:13.980757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc7bcd-db05-4a80-95cc-6ba7dec8ac58 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:14.016075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:14.016632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:14.016903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:14.017190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:14.027150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:14.028600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:14.043818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:14.045262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:14.046615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:14.046615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:14.046615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:14.046615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 629/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:14.050907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:14.152836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:14.160365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa3c7-f031-437c-bc49-cb064081703a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:14.198203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:14.198859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:14.199131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:14.199412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:14.200134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:14.200461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:14.202174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:14.214793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 614/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:14.220659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:14.304465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:14.328314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22da1-823c-4dd8-8afc-fe8834064ab0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:14.366363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:14.367190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:14.367539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:14.367879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:14.375908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:14.377903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:01:14.388843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:14.389784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:14.390678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 630/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 11:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:14.396520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:14.503051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a396-5386-4f3d-aaa9-2201bd8dee8c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:14.538703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:14.539317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:14.539589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:14.539851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:14.540568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:14.540867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:14.542320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a63ff-e6c3-4618-9dfd-7e0b95d651f1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:14.554583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 615/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 11:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:14.563779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:14.676493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30e54-8c46-483f-a58d-98dac1a5ce92 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:14.712952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:14.713752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:14.714093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:14.714400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:14.715097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] RBAC: Adding query filter params (role.id=30979a8d55dd412bac2e5bbccf488d23, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=6fd9a24c27d14095b4a7d1cbd538d34c) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:14.715404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:14.716832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb565c2-c0a6-4ed5-866b-5b6604f37d25 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:14.723303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 631/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 11:01:14 2022] GET /identity/v3/role_assignments?user.id=6fd9a24c27d14095b4a7d1cbd538d34c&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=30979a8d55dd412bac2e5bbccf488d23 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:16.830367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e11723-5c14-45dc-ba58-d4aa72fe7f03 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:16.830925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e11723-5c14-45dc-ba58-d4aa72fe7f03 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:16.830925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e11723-5c14-45dc-ba58-d4aa72fe7f03 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:16.832625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 616/1247] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:16.838025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:16.838451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:16.838606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:16.845292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:16.858850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:16.860091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:16.937164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 632/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:16.961238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e11723-5c14-45dc-ba58-d4aa72fe7f03 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:16.980168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:17.071929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e11723-5c14-45dc-ba58-d4aa72fe7f03 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:17.112730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:17.113304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:17.113577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:17.113836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:17.124798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:01:17.130198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:17.131347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:17.132723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 617/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 11:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:17.137835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:17.251714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1571fc-6b4c-4131-af15-583426e9c338 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:17.282114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:17.287421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:17.288102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:17.288383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:17.288662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:17.289708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:17.290034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:17.291534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:17.300473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 633/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 11:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:17.306924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:17.390809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:17.414849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55382008-0b0e-46ee-bfc2-949182b8febb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:17.452019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:17.452677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:17.452970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:17.453308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:17.463943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:17.465438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:17.480192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:17.481479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:17.482522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:17.482522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:17.482522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:17.482522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 618/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:17.487612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:17.594541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5cd8-e0e5-450a-9351-14c48f2cb8a5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:17.628452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:17.629091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:17.629366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:17.629635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:17.630273 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:17.630569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:17.631938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:17.643934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 634/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:17.649914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:17.756908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234821-b95a-472a-8d31-c0426f58f95d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:17.786453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:17.796077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:17.796706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:17.797004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:17.797336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:17.805586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:17.807062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:01:17.818451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:17.819660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:17.820639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 619/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:17.825667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:17.883762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:17.930449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df893-5cb9-4908-b112-08ff6b1d6b8e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:17.966395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:17.967112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:17.967411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:17.967675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:17.968498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:17.968793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:17.970404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:17.989392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 635/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 10 11:01:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:17.995551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:18.107137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516f21-6a8c-4cb9-990a-e4d428eace38 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:18.147232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:18.147937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:18.148215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:18.148481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:18.210922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:18.224457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:18.226015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:18.327574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 620/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 11:01:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:01:18.333376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:18.438971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d0f6-7842-4beb-89ab-beef1a96add7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:18.454141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:18.476413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:18.477155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:18.477424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:18.477715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:18.488325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:18.489932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:18.504741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:18.506435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:18.507992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:18.507992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:18.507992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:18.507992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 636/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:18.512323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:18.613835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:18.626962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d6c3b-56d2-432f-ada8-7603a9574345 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:18.667512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:18.668135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:18.668409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:18.668675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:18.669355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:18.669656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:18.671063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:18.683056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 621/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:18.688586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:18.796632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee660a-56e7-4620-ba7f-c3cc8f86767e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:18.832486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:18.833154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:18.833405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:18.833671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:18.841002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:18.842661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:01:18.858641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:18.859668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:18.860583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 637/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 11:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:18.866809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:18.999797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ec97-8e74-4abe-8328-b82f9705679f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:19.035476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:19.036082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:19.036382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:19.036639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:19.037326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:19.037655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:19.039036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906bf6-05bc-4b16-b6b7-dc6263cf352a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:19.055593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 622/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 11:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:01:19.061881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:19.087164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:19.172534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147de0-b6a5-4c52-81e6-8dd86deeb9d3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:19.206578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:19.207176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:19.207447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:19.207708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:19.208422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=6fd9a24c27d14095b4a7d1cbd538d34c) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:19.208736 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:19.210189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087afb-5287-4fa5-bca4-441370119820 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:19.215827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 638/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 11:01:19 2022] GET /identity/v3/role_assignments?user.id=6fd9a24c27d14095b4a7d1cbd538d34c&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=b6a5fb3a069640758072d30fba5d307c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:21.291010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cae71-4dae-47b9-a9fb-1f76118dab48 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:21.291557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cae71-4dae-47b9-a9fb-1f76118dab48 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:21.291557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cae71-4dae-47b9-a9fb-1f76118dab48 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:21.293180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 623/1261] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:21.298842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:21.299323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:21.299412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:21.318443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:21.319627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:21.391566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 639/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:21.413367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cae71-4dae-47b9-a9fb-1f76118dab48 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:21.424739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:21.520236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cae71-4dae-47b9-a9fb-1f76118dab48 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:21.554952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:21.555559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:21.555860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:21.556118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:21.566936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:01:21.571627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:21.572703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:21.574031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 624/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 11:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:21.582064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:21.600908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:21.683834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f7949-68cf-4cc3-8ff2-f917e61c8618 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:21.718187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:21.718773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:21.719043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:21.719306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:21.719948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:21.720241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:21.721636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:21.729691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 640/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 11:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:21.739147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:21.811025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:21.845266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37722674-7553-4388-9170-e26f0c9e2ad1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:21.879786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:21.880419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:21.880689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:21.880950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:21.891384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:21.892810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:21.906725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:21.907690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:21.908627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:21.908627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:21.908627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:21.908627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 625/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:21.913892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:21.998317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:22.016961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102dd0-6458-4504-911e-3ce08518ae3f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:22.049739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:22.050338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:22.050609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:22.050869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:22.051499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:22.051792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:22.053173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:22.065440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 641/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:22.071168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:22.173293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e80128-73ed-4def-8505-6866e48b3456 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:22.192892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:22.210178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:22.210808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:22.211106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:22.211368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:22.219679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:22.221162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:01:22.232083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:22.233274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:22.234634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 626/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:22.239378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:22.344492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97e04e-054f-434e-a44b-0f426e8a83e2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:22.380277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:22.380864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:22.381169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:22.381433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:22.382150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:22.382447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:22.383890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:22.392555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:22.407114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 642/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 10 11:01:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:01:22.412998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:22.516664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80398e26-47d4-45c4-a22e-7492c683468d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:22.551665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:22.552272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:22.552545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:22.552811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:22.563639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:22.565095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:22.579296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:22.580377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:22.581384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:22.581384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:22.581384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:22.581384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 627/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:22.586262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:22.689983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd380-8160-440f-bbb3-176ac557553e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:22.724973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:22.725592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:22.725864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:22.726128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:22.726767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:22.727068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:22.728460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:22.739686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 643/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:22.746478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:22.784005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:22.855125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfd34e-d8c3-4208-83c8-0fff0cb6c8b2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:22.890222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:22.890840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:22.891108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:22.891369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:22.898386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:22.899938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:01:22.911232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:22.912261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:22.913387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 628/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 11:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:22.921038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:22.982055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:23.031748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276b7f-1089-42da-be85-f6f8b0ae3377 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:23.071523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:23.072111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:23.072385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:23.072653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:23.073371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:23.073675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:23.075107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcd250-5f1c-46d7-9358-63e1d37de7ef None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:23.087094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 644/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 11:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:23.093515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:23.190564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:23.202719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d25a68-e0c5-4bbe-baed-436001ce4b4f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:23.239448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ad1e8-6267-4537-9e94-e82ad60adaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:23.240029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ad1e8-6267-4537-9e94-e82ad60adaa1 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:23.240303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ad1e8-6267-4537-9e94-e82ad60adaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:23.240570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ad1e8-6267-4537-9e94-e82ad60adaa1 None admin] PATH_INFO: `/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/6fd9a24c27d14095b4a7d1cbd538d34c/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:23.242703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ad1e8-6267-4537-9e94-e82ad60adaa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=264aaf5f81114cd7a530cc98eadcf269, user_id=6fd9a24c27d14095b4a7d1cbd538d34c, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:23.244145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ad1e8-6267-4537-9e94-e82ad60adaa1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:23.261363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 629/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 10 11:01:23 2022] PUT /identity/v3/projects/264aaf5f81114cd7a530cc98eadcf269/users/6fd9a24c27d14095b4a7d1cbd538d34c/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:01:25.214263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913077-46c8-4569-bea9-c6a089035f24 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:25.215084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913077-46c8-4569-bea9-c6a089035f24 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:25.215084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913077-46c8-4569-bea9-c6a089035f24 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:25.217263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 645/1274] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:25.226127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:25.226534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:25.226709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:25.251986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:25.253543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:25.331370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 630/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:25.363521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913077-46c8-4569-bea9-c6a089035f24 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:25.471829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913077-46c8-4569-bea9-c6a089035f24 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:25.490516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:25.511220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:25.511829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:25.512100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:25.512366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:25.524011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:01:25.528691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:25.529737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:25.530804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 646/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 10 11:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:25.536126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:25.618347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:25.642909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1fcf9-b242-450f-a055-3fdda64a3d6f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:25.680087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:25.680739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:25.681026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:25.681313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:25.681966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:25.682258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:25.683612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:25.691658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 631/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 10 11:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:01:25.697478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:25.804843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc705ce1-5b4e-4ffa-b529-b2ccc6cc06a9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:25.840256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:25.840874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:25.841172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:25.841433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:25.851400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:25.852890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:25.867248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:25.868413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:25.869860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:25.869860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:25.869860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:25.869860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 647/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:25.877994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:25.991893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fff885-2ec3-46f3-a40a-25f4ae343a75 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:26.026515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:26.027104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:26.027368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:26.027627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:26.028252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:26.028541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:26.029922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:26.041527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 632/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:26.049613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:26.083129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:26.153945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bee82-ccec-40e9-9004-7aaa575f26e0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:26.191576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:26.192198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:26.192474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:26.192735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:26.201509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:26.202944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:01:26.214074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:26.215639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:26.216846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 648/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:26.223055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:26.228746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:26.332796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f829d-2b9d-4a2c-94b7-08284ca54010 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:26.368973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:26.369529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:26.369797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:26.370059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:26.370769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:26.371067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:26.372476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:26.389603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 633/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 10 11:01:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:26.396115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:26.490150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:26.501210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234d2a2-17b9-4b13-b401-1a58915fd6c1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:26.538812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:26.539393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:26.539667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:26.539930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:26.607476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:26.608932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:26.701059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:26.714289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 649/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 10 11:01:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:01:26.720342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:26.786649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:26.825865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc3d5-876d-4a77-984d-72fe1e4241ba None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:26.861193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:26.861808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:26.862081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:26.862342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:26.873024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:26.874456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:01:26.889952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:26.891080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:01:26.892483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:01:26.892483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:01:26.892483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:26.892483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 634/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:26.899519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:26.996583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1038fa7-131e-4c10-9a25-651aa2dc7297 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:27.031998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:27.032579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:27.032846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:27.033132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:27.033756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:27.034048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:27.035390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:27.046617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 650/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 10 11:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:27.055438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:27.167062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4da121-23dd-48fe-94c4-06be6dd9e7ca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:27.180295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:27.201569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:27.202177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:27.202452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:27.202717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:27.209488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:27.210928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:01:27.222984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:27.223976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: ERROR keystone.server.flask.application Aug 10 11:01:27.225596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 635/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 10 11:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:27.233500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:27.292149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:27.350999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b0e52-5bfd-4b3d-b0b3-4f96623d38d3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:27.386351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:27.386944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:27.387220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:27.387514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:27.388197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:27.388510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:27.389980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625639b-2bf2-4078-9c5b-4ccb3e874f2d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:27.401988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 651/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 10 11:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:27.408935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:27.532220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d145f9-5009-4970-9871-fa80403faa80 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:27.567950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:27.568463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:27.568731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:27.569017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:27.569721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] RBAC: Adding query filter params (role.id=b6a5fb3a069640758072d30fba5d307c, scope.project.id=264aaf5f81114cd7a530cc98eadcf269, user.id=6fd9a24c27d14095b4a7d1cbd538d34c) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:27.570015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:27.571510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cce62-e032-43ff-8f21-4f6db872f942 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:27.577404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 636/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 10 11:01:27 2022] GET /identity/v3/role_assignments?user.id=6fd9a24c27d14095b4a7d1cbd538d34c&scope.project.id=264aaf5f81114cd7a530cc98eadcf269&role.id=b6a5fb3a069640758072d30fba5d307c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:29.561474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef13557-5d80-4cd4-862c-097abf229a70 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:29.562018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef13557-5d80-4cd4-862c-097abf229a70 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:29.562018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef13557-5d80-4cd4-862c-097abf229a70 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:29.563378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 652/1288] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:01:29.569603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:29.570324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:29.570462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:29.595747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:29.596930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:29.630717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:29.671572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 637/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:29.693325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef13557-5d80-4cd4-862c-097abf229a70 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:29.800761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef13557-5d80-4cd4-862c-097abf229a70 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:29.813433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:29.837603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:29.838224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:29.838496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:29.838759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:29.839328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:29.840697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:29.849138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:29.850397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:29.851492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 653/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 11:01:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:29.856459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:29.963861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc50f7-3b49-4743-b035-7262a9fb2556 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:29.998901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:29.999485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:29.999754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:30.000018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:30.000633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:30.000918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:30.002660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18319e96-25d9-45dc-a447-27b66f75835a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:30.007505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 638/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 10 11:01:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:30.015972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:30.126240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b09bd-1452-4683-876e-63725483ae85 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:30.161805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:30.162371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:30.162667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:30.162939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:30.163560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:30.163858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:30.165275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4cbb3-d4ae-4a2b-ba51-bb5356e45dd4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:30.169955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 654/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 10 11:01:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:32.179009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247882-506f-4e0f-8002-ee2a363147bd None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:32.179807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247882-506f-4e0f-8002-ee2a363147bd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:32.179807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247882-506f-4e0f-8002-ee2a363147bd None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:32.182104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 639/1293] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:32.188278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fcde5-28ee-4bfa-9890-d7b9c686fcbe None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:32.188707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fcde5-28ee-4bfa-9890-d7b9c686fcbe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:32.188819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fcde5-28ee-4bfa-9890-d7b9c686fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:32.211735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-368fcde5-28ee-4bfa-9890-d7b9c686fcbe None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:32.212931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-368fcde5-28ee-4bfa-9890-d7b9c686fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:32.246172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:32.290211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 655/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:32.325476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247882-506f-4e0f-8002-ee2a363147bd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:32.362621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:32.444948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247882-506f-4e0f-8002-ee2a363147bd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:32.481499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb5c38-4524-41a5-ae03-394c0d7958b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:32.482096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5c38-4524-41a5-ae03-394c0d7958b2 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:32.482369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5c38-4524-41a5-ae03-394c0d7958b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:32.482630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5c38-4524-41a5-ae03-394c0d7958b2 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:32.483264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb5c38-4524-41a5-ae03-394c0d7958b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:32.484624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb5c38-4524-41a5-ae03-394c0d7958b2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:32.502974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 640/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 10 11:01:32 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:01:34.486561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aafe38-4cc1-418b-9eec-b075a5a8237a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:34.487386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aafe38-4cc1-418b-9eec-b075a5a8237a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:34.487386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aafe38-4cc1-418b-9eec-b075a5a8237a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:34.489413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 656/1296] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:34.495681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:34.496448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:34.496613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:34.520878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:34.522101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:34.610573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 641/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:01:34.637772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aafe38-4cc1-418b-9eec-b075a5a8237a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:34.742090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aafe38-4cc1-418b-9eec-b075a5a8237a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:34.779093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:34.779706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:34.779981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:34.780244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:34.780821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:34.782224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:34.790908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:34.791940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:34.792846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 657/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 11:01:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:34.798215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:34.823703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:34.917648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8b3f-f3b4-4f55-9555-fc109db739e3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:34.953640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:34.954236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:34.954502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:34.954763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:34.955391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:34.955680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:34.957010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:34.962619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 642/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 10 11:01:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:34.972358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:35.005030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:35.077611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deec25-4806-49c4-b608-3d99a6928c82 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:35.112251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:35.112835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:35.113161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:35.113386 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:35.114095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] RBAC: Adding query filter params (interface=public, service_id=7dd2f12caef14123af8e1b1341d418f6, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:35.114394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:35.115768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657c778-6b35-40ff-b88f-7846a54e5e8c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:35.121510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 658/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 10 11:01:34 2022] GET /identity/v3/endpoints?service_id=7dd2f12caef14123af8e1b1341d418f6&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:35.128513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:35.217042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:35.244488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632e9e5-749f-4d98-a173-cfd99ee151bf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:35.282402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d149-c71e-4831-8115-377823c5d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:35.282987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d149-c71e-4831-8115-377823c5d354 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:35.283277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d149-c71e-4831-8115-377823c5d354 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:35.283533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d149-c71e-4831-8115-377823c5d354 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:35.284132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d149-c71e-4831-8115-377823c5d354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:35.285620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d149-c71e-4831-8115-377823c5d354 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:35.292643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 643/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 10 11:01:35 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:01:37.283613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9c25-c289-4ba5-8328-2021c422e8d1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:37.284222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9c25-c289-4ba5-8328-2021c422e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:37.284222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9c25-c289-4ba5-8328-2021c422e8d1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:37.286262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 659/1302] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:01:37.294017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:37.294483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:37.294596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:37.314026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:01:37.315179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:01:37.383271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 644/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:01:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:01:37.419131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d9c25-c289-4ba5-8328-2021c422e8d1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:37.528757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:37.541232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d9c25-c289-4ba5-8328-2021c422e8d1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:37.574002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:37.574605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:37.574870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:37.575131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:37.575697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:37.577078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:01:37.585724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:01:37.586992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Aug 10 11:01:37.588288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 660/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 10 11:01:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:01:37.593208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:37.671095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:37.697503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9a7a-dd25-41f5-b91d-495339c4167c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:37.734330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:37.734910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:37.735177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:37.735437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:37.736056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:01:37.736341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:37.737725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745abd5-bbd7-4484-82a4-4f43827e0ee9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:37.742837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 645/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 10 11:01:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:01:37.748787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:01:37.859691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34eff-9fd8-438e-b8e5-2a0031fc5f7f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:01:37.895210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d574-1621-4685-8bf7-b46b69b03076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:01:37.895811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d574-1621-4685-8bf7-b46b69b03076 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:01:37.896083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d574-1621-4685-8bf7-b46b69b03076 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:01:37.896351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d574-1621-4685-8bf7-b46b69b03076 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:01:37.897023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109d574-1621-4685-8bf7-b46b69b03076 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:01:37.898395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109d574-1621-4685-8bf7-b46b69b03076 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:01:37.930311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 661/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:01:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:01:47.739849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=30 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:01:47.923235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:40.133742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894cb1-3ae1-4d1f-b76c-23c7c20c1c4b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:40.134229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894cb1-3ae1-4d1f-b76c-23c7c20c1c4b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:40.134320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894cb1-3ae1-4d1f-b76c-23c7c20c1c4b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:40.135897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 646/1307] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:40.141203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ad19-3be6-4a6a-b47f-626e7178ad43 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:40.141658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ad19-3be6-4a6a-b47f-626e7178ad43 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:40.141744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ad19-3be6-4a6a-b47f-626e7178ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:40.218425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2fe4ad19-3be6-4a6a-b47f-626e7178ad43 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:40.219524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2fe4ad19-3be6-4a6a-b47f-626e7178ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:40.398664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 662/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:40.464116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39198d-9648-4ad6-8d31-6ae91729960c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:40.464534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39198d-9648-4ad6-8d31-6ae91729960c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:40.464964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39198d-9648-4ad6-8d31-6ae91729960c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:40.467319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 647/1309] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 10 11:02:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:40.487058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053c149-088a-4656-b139-996d6fd20e14 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:40.487834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053c149-088a-4656-b139-996d6fd20e14 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:40.489065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053c149-088a-4656-b139-996d6fd20e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:40.626996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c053c149-088a-4656-b139-996d6fd20e14 None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:40.629019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c053c149-088a-4656-b139-996d6fd20e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:40.653533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:40.718434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 663/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 10 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:40.727283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39198d-9648-4ad6-8d31-6ae91729960c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:40.729466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5c39198d-9648-4ad6-8d31-6ae91729960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:40.853418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39198d-9648-4ad6-8d31-6ae91729960c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:40.937687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:40.938301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:40.938574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:40.938826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:40.940400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:40.996433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:41.060063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:41.062013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97493d-97e1-4ef7-aae4-7704830f6ac1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:41.094593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 648/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:02:43.406205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b707-15d1-48e4-bc93-09239bcc5ca8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:43.406754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b707-15d1-48e4-bc93-09239bcc5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:43.406754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b707-15d1-48e4-bc93-09239bcc5ca8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:43.408007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 664/1312] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:43.413302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8ab58-49a2-4bf1-afa6-077b6890d5f1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:43.413725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8ab58-49a2-4bf1-afa6-077b6890d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:43.413825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8ab58-49a2-4bf1-afa6-077b6890d5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:43.496814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-41c8ab58-49a2-4bf1-afa6-077b6890d5f1 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:43.498048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-41c8ab58-49a2-4bf1-afa6-077b6890d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:43.605828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 649/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:43.659836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b43f8-5f07-43a8-8b96-0761a9eff18b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:43.660115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b43f8-5f07-43a8-8b96-0761a9eff18b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:43.660500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b43f8-5f07-43a8-8b96-0761a9eff18b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:43.661961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 665/1314] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 10 11:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:43.668370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a883-0b3c-4365-939a-273a4a2640cc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:43.668740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a883-0b3c-4365-939a-273a4a2640cc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:43.669120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a883-0b3c-4365-939a-273a4a2640cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:43.681627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:43.749204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ae50a883-0b3c-4365-939a-273a4a2640cc None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:43.750424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ae50a883-0b3c-4365-939a-273a4a2640cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:43.823875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 650/1315] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 10 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:43.833025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b43f8-5f07-43a8-8b96-0761a9eff18b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:43.834589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2b1b43f8-5f07-43a8-8b96-0761a9eff18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:43.942339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b43f8-5f07-43a8-8b96-0761a9eff18b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:44.018123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:44.021332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:44.022473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:44.022473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:44.022699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:44.024995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:44.152765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:44.154333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0628213-049d-4d46-ba59-fc590d892b4b service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:44.173339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 666/1316] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:02:46.696366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b7b9-498f-42ca-b682-b18d0da47303 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:46.697329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b7b9-498f-42ca-b682-b18d0da47303 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:46.697329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b7b9-498f-42ca-b682-b18d0da47303 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:46.699414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 651/1317] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:46.707185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97816-a743-43af-8f4e-5bbf7cb800be None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:46.707618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97816-a743-43af-8f4e-5bbf7cb800be None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:46.707709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97816-a743-43af-8f4e-5bbf7cb800be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:46.778482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-27a97816-a743-43af-8f4e-5bbf7cb800be None None] MFA Rules not processed for user `18066180735a47d6af84e13c7ce55ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:46.780131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-27a97816-a743-43af-8f4e-5bbf7cb800be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:46.833582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:46.880607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 667/1318] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:02:46.922841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b7b9-498f-42ca-b682-b18d0da47303 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:46.924373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7690b7b9-498f-42ca-b682-b18d0da47303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:47.033203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b7b9-498f-42ca-b682-b18d0da47303 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:47.036069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:47.110261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:47.110901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:47.111156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:47.111410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:47.113013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:47.233530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:47.234980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f01ab-b767-469d-80d8-63102a458ac1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:47.254522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 652/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:02:49.814569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7499-9b6e-409d-a5b1-f3881cecd0a4 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:49.815418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7499-9b6e-409d-a5b1-f3881cecd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:49.815418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7499-9b6e-409d-a5b1-f3881cecd0a4 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:49.817554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 668/1320] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:49.826382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863394e-c2ae-4ef1-b69b-2ec41e7b6f9d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:49.827121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863394e-c2ae-4ef1-b69b-2ec41e7b6f9d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:49.827273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863394e-c2ae-4ef1-b69b-2ec41e7b6f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:49.874769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:49.901123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4863394e-c2ae-4ef1-b69b-2ec41e7b6f9d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:49.902335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4863394e-c2ae-4ef1-b69b-2ec41e7b6f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:50.011314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 653/1321] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:50.060607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7499-9b6e-409d-a5b1-f3881cecd0a4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:50.063127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2efb7499-9b6e-409d-a5b1-f3881cecd0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:50.182782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7499-9b6e-409d-a5b1-f3881cecd0a4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:50.257583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:50.258173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:50.258451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:50.258707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:50.260281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:50.268695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:50.375629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:50.377450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953def1c-cce4-4a50-ace4-3678aa79eee3 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:50.397042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 669/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:02:53.294256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef906c4c-18e1-4ef6-8d89-266886702088 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:53.294830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef906c4c-18e1-4ef6-8d89-266886702088 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:53.294830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef906c4c-18e1-4ef6-8d89-266886702088 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:53.296756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 654/1323] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:53.302124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067524-382b-4a0f-b390-ede97cfd7fca None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:53.302594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067524-382b-4a0f-b390-ede97cfd7fca None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:53.302697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067524-382b-4a0f-b390-ede97cfd7fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:53.369642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-98067524-382b-4a0f-b390-ede97cfd7fca None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:53.370839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-98067524-382b-4a0f-b390-ede97cfd7fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:53.436711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:53.480113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 670/1324] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:53.517189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef906c4c-18e1-4ef6-8d89-266886702088 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:53.518799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ef906c4c-18e1-4ef6-8d89-266886702088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:53.632119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef906c4c-18e1-4ef6-8d89-266886702088 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:53.645207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:53.707957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:53.708460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:53.708728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:53.708995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:53.710599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:53.825503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:53.827022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e97c79-41bf-4652-9dbe-26ff35f4fae6 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:53.845600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 655/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:02:55.868645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68772de-1df0-45ac-bf94-f03b3f9b3448 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:55.869206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68772de-1df0-45ac-bf94-f03b3f9b3448 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:55.869206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68772de-1df0-45ac-bf94-f03b3f9b3448 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:55.870444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 671/1326] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:55.876152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b838e-7751-4ff9-a15c-cbf1f10a2de8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:55.876583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b838e-7751-4ff9-a15c-cbf1f10a2de8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:55.876696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b838e-7751-4ff9-a15c-cbf1f10a2de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:55.925849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:55.944804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-911b838e-7751-4ff9-a15c-cbf1f10a2de8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:55.946033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-911b838e-7751-4ff9-a15c-cbf1f10a2de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:56.049350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 656/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:56.085298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68772de-1df0-45ac-bf94-f03b3f9b3448 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:56.086913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b68772de-1df0-45ac-bf94-f03b3f9b3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:56.196281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68772de-1df0-45ac-bf94-f03b3f9b3448 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:56.277272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:56.277875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:56.278143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:56.278400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:56.280087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:56.297566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:56.391165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:56.392483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92828a-fcf9-455a-95bb-8986807d51e5 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:56.411175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 672/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:02:58.472307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc20f-c3c1-43f3-adac-cff759fb7ab0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:58.472867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc20f-c3c1-43f3-adac-cff759fb7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:58.472867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc20f-c3c1-43f3-adac-cff759fb7ab0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:58.474155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 657/1329] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:02:58.479674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd30bdf-e055-45d4-a842-1ceb522e6421 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:58.480448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd30bdf-e055-45d4-a842-1ceb522e6421 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:58.480719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd30bdf-e055-45d4-a842-1ceb522e6421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:58.548697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1dd30bdf-e055-45d4-a842-1ceb522e6421 None None] MFA Rules not processed for user `18066180735a47d6af84e13c7ce55ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:02:58.549955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1dd30bdf-e055-45d4-a842-1ceb522e6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:58.618668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:58.654074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 673/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:02:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:02:58.692804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cc20f-c3c1-43f3-adac-cff759fb7ab0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:02:58.694398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-320cc20f-c3c1-43f3-adac-cff759fb7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:58.805926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cc20f-c3c1-43f3-adac-cff759fb7ab0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:02:58.828833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:02:58.885789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:02:58.886400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:02:58.886675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:02:58.886945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:02:58.888559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:02:59.002089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:02:59.003475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ffe45-59bf-4617-92bd-ef079cc4a494 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:02:59.032533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 658/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:02:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:01.280430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b85d0-ce80-44bb-becf-aa0fac1738c8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:01.281388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b85d0-ce80-44bb-becf-aa0fac1738c8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:01.281388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b85d0-ce80-44bb-becf-aa0fac1738c8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:01.283460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 674/1332] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:01.289737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448162f5-bc5c-4535-92d4-2234a42a8087 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:01.290429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448162f5-bc5c-4535-92d4-2234a42a8087 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:01.290630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448162f5-bc5c-4535-92d4-2234a42a8087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:01.358667 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:01.361910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-448162f5-bc5c-4535-92d4-2234a42a8087 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:01.363822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-448162f5-bc5c-4535-92d4-2234a42a8087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:01.469673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 659/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:01.509595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b85d0-ce80-44bb-becf-aa0fac1738c8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:01.512114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6e7b85d0-ce80-44bb-becf-aa0fac1738c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:01.640592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b85d0-ce80-44bb-becf-aa0fac1738c8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:01.718539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:01.719140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:01.719410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:01.719669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:01.721379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:01.748938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:01.846081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:01.847529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26038-bc59-412d-87cd-eee028889b80 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:01.866316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 675/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:03.886997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d769f9-9051-4517-ba68-0d4c0f214436 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:03.887568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d769f9-9051-4517-ba68-0d4c0f214436 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:03.887568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d769f9-9051-4517-ba68-0d4c0f214436 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:03.889665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 660/1335] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:03.898462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e16e8-0ff8-4e95-8552-624aba153294 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:03.898861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e16e8-0ff8-4e95-8552-624aba153294 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:03.899068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e16e8-0ff8-4e95-8552-624aba153294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:03.975922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c52e16e8-0ff8-4e95-8552-624aba153294 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:03.977844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c52e16e8-0ff8-4e95-8552-624aba153294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:04.058835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:04.082745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 676/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:04.123499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d769f9-9051-4517-ba68-0d4c0f214436 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:04.125050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-10d769f9-9051-4517-ba68-0d4c0f214436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:04.246482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d769f9-9051-4517-ba68-0d4c0f214436 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:04.275464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:04.329845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:04.330448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:04.330718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:04.330977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:04.332644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:04.447914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:04.449379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2b65-85ed-4996-8a2f-9087f71cc0d1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:04.469295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 661/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:06.865325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2565-e3f1-4f2b-a921-bd6fa7811140 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:06.865901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2565-e3f1-4f2b-a921-bd6fa7811140 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:06.865901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2565-e3f1-4f2b-a921-bd6fa7811140 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:06.867225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 677/1338] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:06.873444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4651-1a92-4119-8a8a-7e84633130c3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:06.873865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4651-1a92-4119-8a8a-7e84633130c3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:06.873987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4651-1a92-4119-8a8a-7e84633130c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:06.954293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-53ce4651-1a92-4119-8a8a-7e84633130c3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:06.955500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-53ce4651-1a92-4119-8a8a-7e84633130c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:06.964366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:07.070557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 662/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:07.110097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a2565-e3f1-4f2b-a921-bd6fa7811140 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:07.112453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-579a2565-e3f1-4f2b-a921-bd6fa7811140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:07.224380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a2565-e3f1-4f2b-a921-bd6fa7811140 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:07.304482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:07.305106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:07.305379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:07.305642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:07.307230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:07.342849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:07.429048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:07.430451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf873-6e89-4872-9984-82a2e17cfbc1 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:07.450509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 678/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:11.329883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca6acc-dbd0-4a2a-83cb-f05bf99b792d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:11.330511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca6acc-dbd0-4a2a-83cb-f05bf99b792d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:11.330511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca6acc-dbd0-4a2a-83cb-f05bf99b792d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:11.331779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 663/1341] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:11.337213 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dedda-fdb2-4b47-9bbb-541b66b5e24a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:11.337666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dedda-fdb2-4b47-9bbb-541b66b5e24a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:11.337768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dedda-fdb2-4b47-9bbb-541b66b5e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:11.408065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-943dedda-fdb2-4b47-9bbb-541b66b5e24a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:11.409189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-943dedda-fdb2-4b47-9bbb-541b66b5e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:11.501599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:11.514411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 679/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:11.553561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca6acc-dbd0-4a2a-83cb-f05bf99b792d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:11.555134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-03ca6acc-dbd0-4a2a-83cb-f05bf99b792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:11.664901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca6acc-dbd0-4a2a-83cb-f05bf99b792d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:11.704939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:11.744175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:11.744783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:11.745090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:11.745411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:11.746980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:11.861940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:11.863436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e4f4c-0dd2-40a2-a099-e981e4411483 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:11.882196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 664/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:14.436772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2442a-6e3d-4c97-88b6-9ae011658eaf None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:14.437432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2442a-6e3d-4c97-88b6-9ae011658eaf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:14.437432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2442a-6e3d-4c97-88b6-9ae011658eaf None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:14.438670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 680/1344] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:14.444590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb24c-2657-4fcd-974d-bdd4e591d5a4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:14.445149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb24c-2657-4fcd-974d-bdd4e591d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:14.445149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb24c-2657-4fcd-974d-bdd4e591d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:14.523533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2ebfb24c-2657-4fcd-974d-bdd4e591d5a4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:14.524821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2ebfb24c-2657-4fcd-974d-bdd4e591d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:14.543276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:14.625147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 665/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:14.662994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2442a-6e3d-4c97-88b6-9ae011658eaf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:14.664578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-06b2442a-6e3d-4c97-88b6-9ae011658eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:14.772752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2442a-6e3d-4c97-88b6-9ae011658eaf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:14.849706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:14.850308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:14.850582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:14.850862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:14.852467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:14.896884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:14.964658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:14.966136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63e3c-0a47-4de8-840b-d9ac09e37205 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:14.985327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 681/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:19.256310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536d71e-42dc-4161-bcea-3fb96eb0ca85 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:19.256809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536d71e-42dc-4161-bcea-3fb96eb0ca85 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:19.256913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536d71e-42dc-4161-bcea-3fb96eb0ca85 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:19.258277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 666/1347] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:19.264067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9d659-5da2-45a6-861c-bc75861dbae4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:19.264587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9d659-5da2-45a6-861c-bc75861dbae4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:19.264587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9d659-5da2-45a6-861c-bc75861dbae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:19.339375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5dc9d659-5da2-45a6-861c-bc75861dbae4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:19.340588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5dc9d659-5da2-45a6-861c-bc75861dbae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:19.441727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:19.444661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 682/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:19.483018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536d71e-42dc-4161-bcea-3fb96eb0ca85 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:19.484593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9536d71e-42dc-4161-bcea-3fb96eb0ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:19.598813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536d71e-42dc-4161-bcea-3fb96eb0ca85 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:19.648614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:19.678051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:19.678668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:19.678940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:19.679203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:19.680789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:19.792230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:19.793698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099aa30-76d9-4a6f-aea1-7ba9c08e9820 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:19.812417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 667/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:24.702373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ad744-7d24-4897-8c8c-c0766e03ef4c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:24.702915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ad744-7d24-4897-8c8c-c0766e03ef4c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:24.702915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ad744-7d24-4897-8c8c-c0766e03ef4c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:24.704379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 683/1350] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:24.723248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555ffad-8f51-4901-81ac-68b0aeb17ed7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:24.723743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555ffad-8f51-4901-81ac-68b0aeb17ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:24.723849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555ffad-8f51-4901-81ac-68b0aeb17ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:24.818250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f555ffad-8f51-4901-81ac-68b0aeb17ed7 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:24.818250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f555ffad-8f51-4901-81ac-68b0aeb17ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:24.835835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:24.945295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 668/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:03:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:29.067397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86995231-2347-4624-9e31-90b65b191ab9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:29.067960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86995231-2347-4624-9e31-90b65b191ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:29.068156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86995231-2347-4624-9e31-90b65b191ab9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:29.069812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 684/1352] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:29.074771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad6cc-42e1-45a9-a553-2d1b7b7fd4a5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:29.075239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad6cc-42e1-45a9-a553-2d1b7b7fd4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:29.075343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad6cc-42e1-45a9-a553-2d1b7b7fd4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:29.162628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fc5ad6cc-42e1-45a9-a553-2d1b7b7fd4a5 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:29.163826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fc5ad6cc-42e1-45a9-a553-2d1b7b7fd4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:29.248893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:29.292569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 669/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:03:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:30.473508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df012ed5-3504-4e79-9f80-6eef94422bf6 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:30.474599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df012ed5-3504-4e79-9f80-6eef94422bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:30.475054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df012ed5-3504-4e79-9f80-6eef94422bf6 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:30.476639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 685/1354] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:30.481895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e714-0bb2-4dd3-9a65-df56050d7029 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:30.482374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e714-0bb2-4dd3-9a65-df56050d7029 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:30.482464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e714-0bb2-4dd3-9a65-df56050d7029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:30.558092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e4e4e714-0bb2-4dd3-9a65-df56050d7029 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:30.559295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e4e4e714-0bb2-4dd3-9a65-df56050d7029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:30.666595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 670/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:34.022735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad840c98-33d9-42a0-801d-2607e8a1576c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:34.023690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad840c98-33d9-42a0-801d-2607e8a1576c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:34.024238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad840c98-33d9-42a0-801d-2607e8a1576c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:34.029010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 686/1356] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:34.032320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313786ef-4458-4420-814e-30dbd28b145e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:34.033188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313786ef-4458-4420-814e-30dbd28b145e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:34.033686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313786ef-4458-4420-814e-30dbd28b145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:34.071888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:34.107477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-313786ef-4458-4420-814e-30dbd28b145e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:34.108842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-313786ef-4458-4420-814e-30dbd28b145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:34.213953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 671/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:34.272036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0780d50-bf8d-44e4-bb22-3d23ba97d84c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:34.272812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0780d50-bf8d-44e4-bb22-3d23ba97d84c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:34.273319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0780d50-bf8d-44e4-bb22-3d23ba97d84c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:34.274987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 687/1358] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 10 11:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:34.286555 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565a0d-7380-46b8-bd76-6e1a90bbf660 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:34.287184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565a0d-7380-46b8-bd76-6e1a90bbf660 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:34.287868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565a0d-7380-46b8-bd76-6e1a90bbf660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:34.370276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a7565a0d-7380-46b8-bd76-6e1a90bbf660 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:34.371474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a7565a0d-7380-46b8-bd76-6e1a90bbf660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:34.423295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:34.493721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 672/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 10 11:03:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:34.501924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0780d50-bf8d-44e4-bb22-3d23ba97d84c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:34.503460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e0780d50-bf8d-44e4-bb22-3d23ba97d84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:34.651322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0780d50-bf8d-44e4-bb22-3d23ba97d84c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:34.727880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:34.769637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:34.770741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:34.771019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:34.771287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:34.772923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:34.868784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:34.870404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af31fb-0d0a-4b6d-91ac-1503a71c9c3b service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:34.892516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 688/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:37.144888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66fd07-fdb6-4d8f-9775-860897fa321a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:37.145445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66fd07-fdb6-4d8f-9775-860897fa321a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:37.145717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66fd07-fdb6-4d8f-9775-860897fa321a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:37.147124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 673/1361] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:37.152453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80676df-cd4c-4699-8c97-5b72906f63e5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:37.152925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80676df-cd4c-4699-8c97-5b72906f63e5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:37.152925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80676df-cd4c-4699-8c97-5b72906f63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:37.234205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b80676df-cd4c-4699-8c97-5b72906f63e5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:37.236043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b80676df-cd4c-4699-8c97-5b72906f63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:37.284907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:37.357617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 689/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:37.409443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66fd07-fdb6-4d8f-9775-860897fa321a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:37.411028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8b66fd07-fdb6-4d8f-9775-860897fa321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:37.590205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66fd07-fdb6-4d8f-9775-860897fa321a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:37.600099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:37.708889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:37.709888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:37.710327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:37.710733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:37.712468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:37.806106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:37.807942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec88e9-cdfd-4a19-a0f3-7bf3c944f247 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:37.828546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 674/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:40.189260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f83e7-72d9-450b-8d9e-5c11d4c8b7f7 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.189862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f83e7-72d9-450b-8d9e-5c11d4c8b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.189862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f83e7-72d9-450b-8d9e-5c11d4c8b7f7 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.193029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 690/1364] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:40.196833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ce5e-d761-4c9c-b7eb-d3ac7f61ea04 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.197294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ce5e-d761-4c9c-b7eb-d3ac7f61ea04 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.197388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ce5e-d761-4c9c-b7eb-d3ac7f61ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.214347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.270588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e9e2ce5e-d761-4c9c-b7eb-d3ac7f61ea04 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:40.272153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e9e2ce5e-d761-4c9c-b7eb-d3ac7f61ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:40.376463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 675/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:40.421138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734605eb-a742-4cfe-a539-49a1c788ff22 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.421525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734605eb-a742-4cfe-a539-49a1c788ff22 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.421881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734605eb-a742-4cfe-a539-49a1c788ff22 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.423398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 691/1366] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 10 11:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:40.428888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd45d-e888-4ddf-9591-211caf092f15 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.429220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd45d-e888-4ddf-9591-211caf092f15 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.429491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd45d-e888-4ddf-9591-211caf092f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.507759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-689dd45d-e888-4ddf-9591-211caf092f15 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:40.508968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-689dd45d-e888-4ddf-9591-211caf092f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:40.549327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.638659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 676/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:40.646961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734605eb-a742-4cfe-a539-49a1c788ff22 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.648482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-734605eb-a742-4cfe-a539-49a1c788ff22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:40.800903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734605eb-a742-4cfe-a539-49a1c788ff22 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.822012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.921619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.922217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.922486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.922754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.924338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:41.020366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:41.022080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732fe78-43c4-4d57-b481-ff806d0ef8ab service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:41.042396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 692/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:41.895532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd30a-89bf-4657-af51-d7e71a7cbe26 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:41.896148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd30a-89bf-4657-af51-d7e71a7cbe26 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:41.896148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd30a-89bf-4657-af51-d7e71a7cbe26 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:41.897715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 677/1369] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:41.902805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c72d-9488-4651-83ee-d5a286ae5b31 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:41.903217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c72d-9488-4651-83ee-d5a286ae5b31 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:41.903313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c72d-9488-4651-83ee-d5a286ae5b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:41.936663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:41.972867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2269c72d-9488-4651-83ee-d5a286ae5b31 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:41.974128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2269c72d-9488-4651-83ee-d5a286ae5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:42.077734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 693/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:03:42.420100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05492d2-19e9-4f83-8ece-88d31b3ace75 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:42.420100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05492d2-19e9-4f83-8ece-88d31b3ace75 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:42.420100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05492d2-19e9-4f83-8ece-88d31b3ace75 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:42.423419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 678/1371] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 10 11:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:42.425970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc621fe3-c447-474b-b628-7292712697f3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:42.426165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc621fe3-c447-474b-b628-7292712697f3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:42.426438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc621fe3-c447-474b-b628-7292712697f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:42.505359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bc621fe3-c447-474b-b628-7292712697f3 None None] MFA Rules not processed for user `b1604862a92742d8bd8d1ca837a63c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:42.506581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bc621fe3-c447-474b-b628-7292712697f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:42.557670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:42.591983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 694/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 10 11:03:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:42.600041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05492d2-19e9-4f83-8ece-88d31b3ace75 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:42.601569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b05492d2-19e9-4f83-8ece-88d31b3ace75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:42.717435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05492d2-19e9-4f83-8ece-88d31b3ace75 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:42.763929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:42.801351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:42.801947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:42.802219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:42.802476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:42.804068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:42.924034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:42.925523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a29a-df8e-4ef3-8a44-4ea3a65c3321 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:42.944850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 679/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:43.109092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a29b9-9a7c-49d4-b275-db34945ff008 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.109994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a29b9-9a7c-49d4-b275-db34945ff008 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.109994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a29b9-9a7c-49d4-b275-db34945ff008 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.118187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 695/1374] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:43.122657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520afa1d-3d9f-470b-a5db-738bac08e929 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.123063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520afa1d-3d9f-470b-a5db-738bac08e929 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.123215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520afa1d-3d9f-470b-a5db-738bac08e929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.190662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-520afa1d-3d9f-470b-a5db-738bac08e929 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:43.191873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-520afa1d-3d9f-470b-a5db-738bac08e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:43.214098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.293290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 680/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:43.336269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a29b9-9a7c-49d4-b275-db34945ff008 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.337944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ed4a29b9-9a7c-49d4-b275-db34945ff008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:43.492480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a29b9-9a7c-49d4-b275-db34945ff008 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.546713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.608908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.609529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.609798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.610059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.611676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:43.703387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.705039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b1042-c315-4bc4-81fd-d9b3ff6547ce service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.724617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 696/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:45.727211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a3f3-8faf-4ee3-822d-c216ba9b9975 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:45.727790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a3f3-8faf-4ee3-822d-c216ba9b9975 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:45.727790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a3f3-8faf-4ee3-822d-c216ba9b9975 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:45.729133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 681/1377] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:45.734453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa515-8934-462c-8151-bd29f37f939c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:45.734894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa515-8934-462c-8151-bd29f37f939c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:45.734986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa515-8934-462c-8151-bd29f37f939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:45.810000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e60aa515-8934-462c-8151-bd29f37f939c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:45.811184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e60aa515-8934-462c-8151-bd29f37f939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:45.818703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:45.924966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 697/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:45.969023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846a3f3-8faf-4ee3-822d-c216ba9b9975 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:45.970633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6846a3f3-8faf-4ee3-822d-c216ba9b9975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:46.145080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846a3f3-8faf-4ee3-822d-c216ba9b9975 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:46.148770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:46.280943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:46.281692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:46.282027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:46.282355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:46.284003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:46.399580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:46.401526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d10c16-16fd-4d00-bdb8-6186a699b7b8 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:46.437388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 682/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:48.448527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61926-8af2-433c-960e-1ad593120d80 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:48.449338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61926-8af2-433c-960e-1ad593120d80 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:48.449338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61926-8af2-433c-960e-1ad593120d80 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:48.450409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 698/1380] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:48.455997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f152a-3443-4e3b-8e44-83d79f080c8c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:48.456465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f152a-3443-4e3b-8e44-83d79f080c8c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:48.456725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f152a-3443-4e3b-8e44-83d79f080c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:48.468424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:48.529240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-163f152a-3443-4e3b-8e44-83d79f080c8c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:48.530617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-163f152a-3443-4e3b-8e44-83d79f080c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:48.636917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 683/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:48.681664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e61926-8af2-433c-960e-1ad593120d80 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:48.683323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-11e61926-8af2-433c-960e-1ad593120d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:48.832438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:48.846934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e61926-8af2-433c-960e-1ad593120d80 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:48.966249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:48.966850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:48.967118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:48.967378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:48.969028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:49.064399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:49.066661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc64e8-95ed-4fd6-a709-cf76575542dd service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:49.078730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:49.089584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 699/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:51.148211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1891fb-0e50-44fe-8f46-fb31f6abf174 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.148736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1891fb-0e50-44fe-8f46-fb31f6abf174 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.148834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1891fb-0e50-44fe-8f46-fb31f6abf174 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.150262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 684/1383] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:51.156482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07250352-923e-494d-ae00-82dbc10098b5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.157029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07250352-923e-494d-ae00-82dbc10098b5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.157122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07250352-923e-494d-ae00-82dbc10098b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.231550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-07250352-923e-494d-ae00-82dbc10098b5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:51.232884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-07250352-923e-494d-ae00-82dbc10098b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:51.344179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 700/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:51.388955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1891fb-0e50-44fe-8f46-fb31f6abf174 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.391117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3e1891fb-0e50-44fe-8f46-fb31f6abf174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:51.494240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.556835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1891fb-0e50-44fe-8f46-fb31f6abf174 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.701928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.702944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.703287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.703648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.705859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:51.772176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.819139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.821470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039863b4-1fb0-4fa3-9040-4c511254bb8b service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.845495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 685/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:54.479445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3e98-86ba-4a83-89c8-e482f69601a2 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.480046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3e98-86ba-4a83-89c8-e482f69601a2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.480046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3e98-86ba-4a83-89c8-e482f69601a2 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.481774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 701/1386] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:54.489005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f6db8-addc-4054-b27b-e538c55d2d22 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.489476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f6db8-addc-4054-b27b-e538c55d2d22 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.489733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f6db8-addc-4054-b27b-e538c55d2d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.578502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d64f6db8-addc-4054-b27b-e538c55d2d22 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:54.579909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d64f6db8-addc-4054-b27b-e538c55d2d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:54.692294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 686/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:54.738904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b3e98-86ba-4a83-89c8-e482f69601a2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:54.740524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-602b3e98-86ba-4a83-89c8-e482f69601a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:54.822975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:54.894687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b3e98-86ba-4a83-89c8-e482f69601a2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.020618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.021245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.021521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.021785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.023595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:55.073472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.132354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:55.134130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af39f1e-d90a-4499-81cc-03c0d8e3b33b service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:55.153449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 702/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:57.174253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b06d54-89d3-4aa6-b881-63ecdd91d2f4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.174788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b06d54-89d3-4aa6-b881-63ecdd91d2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.174788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b06d54-89d3-4aa6-b881-63ecdd91d2f4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.176096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 687/1389] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:57.181421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b2e5-a5b4-41ba-81c0-3f9b0f03e609 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.181857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b2e5-a5b4-41ba-81c0-3f9b0f03e609 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.181953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b2e5-a5b4-41ba-81c0-3f9b0f03e609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.250285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8908b2e5-a5b4-41ba-81c0-3f9b0f03e609 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:57.251461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8908b2e5-a5b4-41ba-81c0-3f9b0f03e609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:57.350440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 703/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:57.394566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b06d54-89d3-4aa6-b881-63ecdd91d2f4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.396076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-23b06d54-89d3-4aa6-b881-63ecdd91d2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:57.428013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.550737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b06d54-89d3-4aa6-b881-63ecdd91d2f4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.656469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.669297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.669904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.670174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.670435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.672101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:57.760823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.762449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831e9c8-cd6b-451f-b42b-091edcb43c67 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.781145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 688/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:57.830107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170ac7-85d4-4093-97d4-ce832502dc10 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.830432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170ac7-85d4-4093-97d4-ce832502dc10 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.830723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170ac7-85d4-4093-97d4-ce832502dc10 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.832059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 704/1392] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:57.838075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9fe6-2e08-4962-a565-8a8c43a6e393 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.838411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9fe6-2e08-4962-a565-8a8c43a6e393 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.838675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9fe6-2e08-4962-a565-8a8c43a6e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.918400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-90aa9fe6-2e08-4962-a565-8a8c43a6e393 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:57.919540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-90aa9fe6-2e08-4962-a565-8a8c43a6e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:57.983823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.024820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 689/1393] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:58.080018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd291-6b6a-4960-b8e2-36c5e7d63a63 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.080295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd291-6b6a-4960-b8e2-36c5e7d63a63 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.080560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd291-6b6a-4960-b8e2-36c5e7d63a63 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.081931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 705/1394] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 10 11:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:58.087322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657bff6-db3a-4e63-a35d-0c3d81333bc7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.087608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657bff6-db3a-4e63-a35d-0c3d81333bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.087849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657bff6-db3a-4e63-a35d-0c3d81333bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.171797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c657bff6-db3a-4e63-a35d-0c3d81333bc7 None None] MFA Rules not processed for user `f1d18e6612024b4cbef06e5da57d4bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:58.172906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c657bff6-db3a-4e63-a35d-0c3d81333bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:58.249505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 690/1395] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 10 11:03:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:03:58.257454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bd291-6b6a-4960-b8e2-36c5e7d63a63 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.258994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a19bd291-6b6a-4960-b8e2-36c5e7d63a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:58.273658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.372000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bd291-6b6a-4960-b8e2-36c5e7d63a63 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.455152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.455663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.455943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.456295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.458255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:58.531546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.574839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:58.576272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8231c9-1219-4438-9fa0-b43cd8491e5e service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:58.598296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 706/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:03:59.357059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517103c-8613-4ca9-9cb0-ff011bb30da1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.357568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517103c-8613-4ca9-9cb0-ff011bb30da1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.357667 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517103c-8613-4ca9-9cb0-ff011bb30da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.428659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5517103c-8613-4ca9-9cb0-ff011bb30da1 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:59.429905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5517103c-8613-4ca9-9cb0-ff011bb30da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:59.438731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:59.520962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 691/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:59.563966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59867a8-dfb1-462f-b7c4-93a78ba68ca1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.564507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59867a8-dfb1-462f-b7c4-93a78ba68ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.564507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59867a8-dfb1-462f-b7c4-93a78ba68ca1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.565868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 707/1398] 10.222.0.42 () {54 vars in 943 bytes} [Wed Aug 10 11:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:59.572521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447c712-e385-4863-83e6-4f6c4de2fe04 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.572773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447c712-e385-4863-83e6-4f6c4de2fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.573161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447c712-e385-4863-83e6-4f6c4de2fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.651267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2447c712-e385-4863-83e6-4f6c4de2fe04 None None] MFA Rules not processed for user `8553125282aa414db923858f1e27c76f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:59.652380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2447c712-e385-4863-83e6-4f6c4de2fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:59.738814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:59.762311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 692/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Wed Aug 10 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:03:59.772141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59867a8-dfb1-462f-b7c4-93a78ba68ca1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:59.773654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d59867a8-dfb1-462f-b7c4-93a78ba68ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:59.825804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9698-09fe-4e3f-bf6a-63ead5ddf021 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.826057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9698-09fe-4e3f-bf6a-63ead5ddf021 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.826307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9698-09fe-4e3f-bf6a-63ead5ddf021 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.827754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 693/1400] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:59.832704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.833042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.833307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.898277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:59.899495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:59.913982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59867a8-dfb1-462f-b7c4-93a78ba68ca1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:59.951285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:59.996321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 694/1401] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:04:00.019865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:00.020472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.020745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.021037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.022673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:00.041016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:00.042231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:00.107334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:00.107547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:00.110103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b956d-8e99-4f45-941e-66758fc6bc5d service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:00.118572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 708/1402] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:04:00.164884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf04d78-e8b2-42c7-b595-dbeb8cb8bc6b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:00.297175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:00.297795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.298070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.298336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.299922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:00.365908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:00.398041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:00.399649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cdd7d-2508-4cab-9e54-b4074df1755a service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:00.419362 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 695/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:02.436631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbb6e8-7a44-4f48-9695-df8605fdef3a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.437831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbb6e8-7a44-4f48-9695-df8605fdef3a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.438318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbb6e8-7a44-4f48-9695-df8605fdef3a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.440074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 709/1404] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:02.445577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c67184-f0db-4b27-8c1d-3029c8c99278 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.446025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c67184-f0db-4b27-8c1d-3029c8c99278 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.446122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c67184-f0db-4b27-8c1d-3029c8c99278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.526209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-58c67184-f0db-4b27-8c1d-3029c8c99278 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:02.527434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-58c67184-f0db-4b27-8c1d-3029c8c99278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:02.639458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 696/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:02.680989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbb6e8-7a44-4f48-9695-df8605fdef3a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.682550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c7dbb6e8-7a44-4f48-9695-df8605fdef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:02.762009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.878346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbb6e8-7a44-4f48-9695-df8605fdef3a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.996463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.997114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.997382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.997833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.999914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:03.033071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.098584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.100226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d1a4-2cd8-4a85-8c34-0549901f235c service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.118885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 710/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:05.160640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48588cf0-3e99-4c7e-a303-ba1f4214b82d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.161247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48588cf0-3e99-4c7e-a303-ba1f4214b82d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.161247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48588cf0-3e99-4c7e-a303-ba1f4214b82d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.165330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 697/1407] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:05.167845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa5a3-b6b3-47f1-ae6a-2a26a08397fe None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.168771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa5a3-b6b3-47f1-ae6a-2a26a08397fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.169072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa5a3-b6b3-47f1-ae6a-2a26a08397fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.239499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7a2fa5a3-b6b3-47f1-ae6a-2a26a08397fe None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:05.240815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7a2fa5a3-b6b3-47f1-ae6a-2a26a08397fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:05.349083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 711/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:04:05.392399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48588cf0-3e99-4c7e-a303-ba1f4214b82d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:05.395081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-48588cf0-3e99-4c7e-a303-ba1f4214b82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:05.436030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:05.560410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48588cf0-3e99-4c7e-a303-ba1f4214b82d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:05.678978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:05.685606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:05.686255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.686528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.686797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.688387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:05.788119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:05.790057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5d61-5b67-470c-83dd-c563192143a5 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:05.810891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 698/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:15.345502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:15.807198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=47 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:21.900371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581627e2-4919-4fb6-8c54-893432f448fe None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.901041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581627e2-4919-4fb6-8c54-893432f448fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.901041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581627e2-4919-4fb6-8c54-893432f448fe None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.902893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 712/1410] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 10 11:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:21.908369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407f91-f49e-46cc-875f-a07ee3bf1d80 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.908794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407f91-f49e-46cc-875f-a07ee3bf1d80 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.908893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407f91-f49e-46cc-875f-a07ee3bf1d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.988373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fc407f91-f49e-46cc-875f-a07ee3bf1d80 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:21.989629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fc407f91-f49e-46cc-875f-a07ee3bf1d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:22.102607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 699/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 10 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:22.117399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a893ef-d49a-4aa0-a3c2-7b712f0c44c0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.117654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a893ef-d49a-4aa0-a3c2-7b712f0c44c0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.117916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a893ef-d49a-4aa0-a3c2-7b712f0c44c0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.119283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 713/1412] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 10 11:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:22.124574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609236-dcd8-490c-8522-f348c9edebcc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.124883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609236-dcd8-490c-8522-f348c9edebcc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.125194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609236-dcd8-490c-8522-f348c9edebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.207963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:22.211100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c2609236-dcd8-490c-8522-f348c9edebcc None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:22.213062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c2609236-dcd8-490c-8522-f348c9edebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:22.334418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 700/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 10 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:24.784130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ceab-73d5-4ddb-94d7-29facbad207a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.784668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ceab-73d5-4ddb-94d7-29facbad207a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.784668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ceab-73d5-4ddb-94d7-29facbad207a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.786052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:24.791969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d971-5d82-4a43-91e0-89ade7c2fbd8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.792457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d971-5d82-4a43-91e0-89ade7c2fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.792569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d971-5d82-4a43-91e0-89ade7c2fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.862913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2792d971-5d82-4a43-91e0-89ade7c2fbd8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:24.864107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2792d971-5d82-4a43-91e0-89ade7c2fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:24.926439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:24.970318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:25.020430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ceab-73d5-4ddb-94d7-29facbad207a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.022627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1ad9ceab-73d5-4ddb-94d7-29facbad207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:25.180011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ceab-73d5-4ddb-94d7-29facbad207a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.254955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.298458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.299070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.299341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.299598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.301229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:25.393356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.394882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf33e-3bfd-40b1-825b-0339d52547bb service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.412828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 715/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:26.321402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784c6b-ca41-4dea-98e8-51692098717f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.322004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784c6b-ca41-4dea-98e8-51692098717f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.322004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784c6b-ca41-4dea-98e8-51692098717f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.323303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:26.330129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50796b-bd94-47a2-9e76-3731cbbef0f2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.330905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50796b-bd94-47a2-9e76-3731cbbef0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.331014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50796b-bd94-47a2-9e76-3731cbbef0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.416074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fa50796b-bd94-47a2-9e76-3731cbbef0f2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:26.417316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fa50796b-bd94-47a2-9e76-3731cbbef0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:26.449638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.522940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:26.674994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784c6b-ca41-4dea-98e8-51692098717f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.677232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1e784c6b-ca41-4dea-98e8-51692098717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:26.849179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784c6b-ca41-4dea-98e8-51692098717f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.892406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.974549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.975214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.975539 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.975874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.978382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:27.079645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.081297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3a37-f07d-41f6-8f33-6b1abee01973 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.099884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 703/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:27.980394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375e5a-60c0-48a9-9596-e9c9d50cb850 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.981380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375e5a-60c0-48a9-9596-e9c9d50cb850 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.981380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375e5a-60c0-48a9-9596-e9c9d50cb850 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.983363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:27.989629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd9a-3362-483b-aa7d-addc8de776ed None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.990379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd9a-3362-483b-aa7d-addc8de776ed None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.990550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd9a-3362-483b-aa7d-addc8de776ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.051414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.074163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eca9dd9a-3362-483b-aa7d-addc8de776ed None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:28.075367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eca9dd9a-3362-483b-aa7d-addc8de776ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:28.177952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:28.329372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35375e5a-60c0-48a9-9596-e9c9d50cb850 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.330922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-35375e5a-60c0-48a9-9596-e9c9d50cb850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:28.484095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35375e5a-60c0-48a9-9596-e9c9d50cb850 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.496302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.614553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.615058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.615326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.615586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.617210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:28.708565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.710171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5308037-ff4b-465b-8a3a-a00febfdc4ea service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.728283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 718/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:29.605212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95590-a8b4-48ea-9d7f-750a5456777d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.605807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95590-a8b4-48ea-9d7f-750a5456777d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.605807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95590-a8b4-48ea-9d7f-750a5456777d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.607122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:29.613140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26916e-0eac-4750-9504-4002ce429e51 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.613587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26916e-0eac-4750-9504-4002ce429e51 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.613714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26916e-0eac-4750-9504-4002ce429e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.641901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:29.715976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0e26916e-0eac-4750-9504-4002ce429e51 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:29.717290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0e26916e-0eac-4750-9504-4002ce429e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:29.817088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:29.969735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95590-a8b4-48ea-9d7f-750a5456777d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:29.971932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6ce95590-a8b4-48ea-9d7f-750a5456777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:30.105311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.144712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95590-a8b4-48ea-9d7f-750a5456777d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.264250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.264783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.265089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.265355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.267113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:30.346576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.366023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.367672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ef896-5957-4ba8-ba17-e52820bc4fe2 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.387147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 706/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:31.248355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89cd2-98ed-462a-a63b-104b37d59f47 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.249666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89cd2-98ed-462a-a63b-104b37d59f47 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.249666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89cd2-98ed-462a-a63b-104b37d59f47 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.251764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:31.256907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90420-bc8a-42be-9f99-f9b6162a2c24 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.257371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90420-bc8a-42be-9f99-f9b6162a2c24 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.257486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90420-bc8a-42be-9f99-f9b6162a2c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.335522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2ca90420-bc8a-42be-9f99-f9b6162a2c24 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:31.336711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2ca90420-bc8a-42be-9f99-f9b6162a2c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:31.442693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:31.596466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89cd2-98ed-462a-a63b-104b37d59f47 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.598884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28d89cd2-98ed-462a-a63b-104b37d59f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:31.702448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.766379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89cd2-98ed-462a-a63b-104b37d59f47 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.882640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.883243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.883514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.883779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.885432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:31.936196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.977504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:31.979041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a3fa2-0ac7-4a0f-901f-f1ad9a826d63 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.001815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 721/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:32.804616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4b010-afcc-4074-9bf8-9f51c54a2a63 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.805222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4b010-afcc-4074-9bf8-9f51c54a2a63 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.805222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4b010-afcc-4074-9bf8-9f51c54a2a63 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.806505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:32.812632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66215257-289e-4447-90cc-b8fbe9b917e3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.813079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66215257-289e-4447-90cc-b8fbe9b917e3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.813202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66215257-289e-4447-90cc-b8fbe9b917e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.895506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-66215257-289e-4447-90cc-b8fbe9b917e3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:32.896687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-66215257-289e-4447-90cc-b8fbe9b917e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:32.994946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:33.141980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4b010-afcc-4074-9bf8-9f51c54a2a63 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:33.143491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1be4b010-afcc-4074-9bf8-9f51c54a2a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:33.202260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:33.308055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4b010-afcc-4074-9bf8-9f51c54a2a63 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:33.430646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:33.431155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:33.431445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:33.431708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:33.433330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:33.440630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:33.530428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:33.532029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf714-c0bd-43cd-91cf-7bda5d61748b service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:33.551553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 709/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:34.378392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba52c-a965-4027-99d4-4a11305089eb None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.379365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba52c-a965-4027-99d4-4a11305089eb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.379365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba52c-a965-4027-99d4-4a11305089eb None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.381485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:34.386630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5e36-653f-49c7-9b1a-557b23243a33 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.387056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5e36-653f-49c7-9b1a-557b23243a33 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.387179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5e36-653f-49c7-9b1a-557b23243a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.468820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-669d5e36-653f-49c7-9b1a-557b23243a33 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:34.470160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-669d5e36-653f-49c7-9b1a-557b23243a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:34.539916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.569121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:04:34.718335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba52c-a965-4027-99d4-4a11305089eb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:34.720695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a66ba52c-a965-4027-99d4-4a11305089eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:34.749751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.887284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba52c-a965-4027-99d4-4a11305089eb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.976569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.005366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.006004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.006276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.006538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.008139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:35.108029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.109698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b898-5028-4637-abdf-64762a3bc990 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.129272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 724/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:35.928260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c69f26-9912-4ec2-a26d-2dbfc2b0073e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.929209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c69f26-9912-4ec2-a26d-2dbfc2b0073e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.929209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c69f26-9912-4ec2-a26d-2dbfc2b0073e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.931507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:35.937300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f5f22-f048-4c7b-a931-ee0dd005906a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.938051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f5f22-f048-4c7b-a931-ee0dd005906a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.938197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f5f22-f048-4c7b-a931-ee0dd005906a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.020467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0c5f5f22-f048-4c7b-a931-ee0dd005906a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:36.021848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c5f5f22-f048-4c7b-a931-ee0dd005906a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:36.066623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.122033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:36.271786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c69f26-9912-4ec2-a26d-2dbfc2b0073e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.274177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-53c69f26-9912-4ec2-a26d-2dbfc2b0073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:36.569486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c69f26-9912-4ec2-a26d-2dbfc2b0073e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.628689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.693709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.694315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.694594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.694855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.696446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:36.803255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.805780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051e888-3d0e-4064-97dc-9602ea802cb8 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.830732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 712/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:37.634334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6404d-cc91-41d4-a94b-bcfeed2fb71d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:37.635234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6404d-cc91-41d4-a94b-bcfeed2fb71d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:37.635234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6404d-cc91-41d4-a94b-bcfeed2fb71d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:37.637395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:37.643429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75ff0c-3e9e-4704-b256-c6dcc25a6987 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:37.644225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75ff0c-3e9e-4704-b256-c6dcc25a6987 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:37.644392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75ff0c-3e9e-4704-b256-c6dcc25a6987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:37.727355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2b75ff0c-3e9e-4704-b256-c6dcc25a6987 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:37.728555 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2b75ff0c-3e9e-4704-b256-c6dcc25a6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:37.730710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:37.827808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:37.986260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6404d-cc91-41d4-a94b-bcfeed2fb71d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:37.988663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-23d6404d-cc91-41d4-a94b-bcfeed2fb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:38.159528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6404d-cc91-41d4-a94b-bcfeed2fb71d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:38.187705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:38.280315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:38.280916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:38.281217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:38.281480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:38.283170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:38.373230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:38.375207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8921f0e-ff72-4265-82bc-5f9499de1db5 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:38.393255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 727/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:40.261270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4da6-ef70-45f6-a83e-6deb4337b66c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.262199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4da6-ef70-45f6-a83e-6deb4337b66c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.262199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4da6-ef70-45f6-a83e-6deb4337b66c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.264312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:40.271677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d37e-9758-46f3-8578-be6dce38cac8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.272088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d37e-9758-46f3-8578-be6dce38cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.272230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d37e-9758-46f3-8578-be6dce38cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.325616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.351620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9705d37e-9758-46f3-8578-be6dce38cac8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:40.352825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9705d37e-9758-46f3-8578-be6dce38cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:40.451311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:40.491657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b4da6-ef70-45f6-a83e-6deb4337b66c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.493248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7a6b4da6-ef70-45f6-a83e-6deb4337b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:40.604808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b4da6-ef70-45f6-a83e-6deb4337b66c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.645624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.689391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.689994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.690233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.690517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.692096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:40.810033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.811382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3135b-e5d1-4618-8f28-08f957a35a50 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.830309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 715/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:43.085252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6767-60ea-423a-8ef5-8b95a6dbe46a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.086163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6767-60ea-423a-8ef5-8b95a6dbe46a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.086163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6767-60ea-423a-8ef5-8b95a6dbe46a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.088321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:43.093856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9004-ad61-4249-af76-1a616b7a8da9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.094297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9004-ad61-4249-af76-1a616b7a8da9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.094399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9004-ad61-4249-af76-1a616b7a8da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.165162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cdfc9004-ad61-4249-af76-1a616b7a8da9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:43.166378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cdfc9004-ad61-4249-af76-1a616b7a8da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:43.180371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:43.267225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:43.309939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6767-60ea-423a-8ef5-8b95a6dbe46a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:43.312299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-322a6767-60ea-423a-8ef5-8b95a6dbe46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:43.427006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6767-60ea-423a-8ef5-8b95a6dbe46a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:43.439555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:43.514893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:43.515487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.515759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.516025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.517696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:43.631847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:43.633309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a2f2f-13bf-40f0-8720-61dd7d5a98ab service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:43.654933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 730/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:45.999940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588eb08-ca5e-4957-8f37-42556a1dbfb2 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.000864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588eb08-ca5e-4957-8f37-42556a1dbfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.000864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588eb08-ca5e-4957-8f37-42556a1dbfb2 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.002905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:46.011574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b02f9-8c6c-497f-ac0c-8ba8d3158703 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.012275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b02f9-8c6c-497f-ac0c-8ba8d3158703 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.012443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b02f9-8c6c-497f-ac0c-8ba8d3158703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.063295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.081527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-471b02f9-8c6c-497f-ac0c-8ba8d3158703 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:46.082721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-471b02f9-8c6c-497f-ac0c-8ba8d3158703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:46.182046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:46.229660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588eb08-ca5e-4957-8f37-42556a1dbfb2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.231260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2588eb08-ca5e-4957-8f37-42556a1dbfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:46.342689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588eb08-ca5e-4957-8f37-42556a1dbfb2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.383469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.418186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.418799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.419071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.419328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.420913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:46.533720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.535160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1067f-f1ae-443b-b92e-a351ccb213d2 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.554139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 718/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:48.649466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c461-e1a1-4dbf-a4d4-753208db333d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.650078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c461-e1a1-4dbf-a4d4-753208db333d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.650078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c461-e1a1-4dbf-a4d4-753208db333d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.651350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:48.657733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd0415-0dde-45e7-bbec-aa95904f3249 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.658176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd0415-0dde-45e7-bbec-aa95904f3249 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.658298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd0415-0dde-45e7-bbec-aa95904f3249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.735913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f1cd0415-0dde-45e7-bbec-aa95904f3249 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:48.737166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1cd0415-0dde-45e7-bbec-aa95904f3249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:48.760939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:48.843898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:48.887660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c461-e1a1-4dbf-a4d4-753208db333d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.889197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52e4c461-e1a1-4dbf-a4d4-753208db333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:49.004677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c461-e1a1-4dbf-a4d4-753208db333d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.025788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:49.079681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.080293 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.080573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.080837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.082530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:49.196433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:49.197925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311b09-56f9-4aff-ab7b-35fac93ca707 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:49.216168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 733/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:51.274691 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064140-6255-469b-a308-328210110fdf None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.275276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064140-6255-469b-a308-328210110fdf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.275276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064140-6255-469b-a308-328210110fdf None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.277435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:51.286288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb6d3-8815-4eb4-9b79-2945c0138f6d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.287030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb6d3-8815-4eb4-9b79-2945c0138f6d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.287182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb6d3-8815-4eb4-9b79-2945c0138f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.356823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.360039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-48cfb6d3-8815-4eb4-9b79-2945c0138f6d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:51.362028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-48cfb6d3-8815-4eb4-9b79-2945c0138f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:51.471053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:51.509972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064140-6255-469b-a308-328210110fdf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.512238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63064140-6255-469b-a308-328210110fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:51.631530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064140-6255-469b-a308-328210110fdf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.684903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.711748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.712350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.712623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.712926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.714525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:51.841471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.848494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a59c16-0597-452e-b147-bb363a7413c1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.867608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 721/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:53.903808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d79ef9-47f2-4a88-81ef-007b3cc6afbf None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.904395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d79ef9-47f2-4a88-81ef-007b3cc6afbf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.904395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d79ef9-47f2-4a88-81ef-007b3cc6afbf None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.905756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:53.911187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fe91-b2de-4e90-bf18-609125a3ef73 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.911710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fe91-b2de-4e90-bf18-609125a3ef73 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.911710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fe91-b2de-4e90-bf18-609125a3ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.982940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7cf3fe91-b2de-4e90-bf18-609125a3ef73 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:53.984142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7cf3fe91-b2de-4e90-bf18-609125a3ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:54.014819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.085165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:54.123220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d79ef9-47f2-4a88-81ef-007b3cc6afbf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.125153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-58d79ef9-47f2-4a88-81ef-007b3cc6afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:54.249634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d79ef9-47f2-4a88-81ef-007b3cc6afbf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.285817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.331637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.332231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.332504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.332762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.334379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:54.446790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.448212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a574b7b-bfd2-4852-ba10-76277ceebcf7 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.595083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 736/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:56.599355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19c031-1b7d-49bf-b4d5-a7cbe9321869 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.599956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19c031-1b7d-49bf-b4d5-a7cbe9321869 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.599956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19c031-1b7d-49bf-b4d5-a7cbe9321869 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.601276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:56.606776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74aa78-e796-4750-a967-3510e918c778 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.607200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74aa78-e796-4750-a967-3510e918c778 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.607316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74aa78-e796-4750-a967-3510e918c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.674847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ca74aa78-e796-4750-a967-3510e918c778 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:56.676025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ca74aa78-e796-4750-a967-3510e918c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:56.684329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.773568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:04:56.814122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19c031-1b7d-49bf-b4d5-a7cbe9321869 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.816483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ce19c031-1b7d-49bf-b4d5-a7cbe9321869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:56.935577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19c031-1b7d-49bf-b4d5-a7cbe9321869 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.003182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.023138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.023736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.024005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.024265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.025902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:57.142163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.143595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbde43d-c437-4b04-b6e7-9b12c401a81d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.162302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 724/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:04:59.198436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccffd7-cacb-4519-aa1a-c132a71f1b31 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.199266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccffd7-cacb-4519-aa1a-c132a71f1b31 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.199266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccffd7-cacb-4519-aa1a-c132a71f1b31 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.201473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:04:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:59.209650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17848c-4871-41ef-aa15-7753472df7dd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.210094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17848c-4871-41ef-aa15-7753472df7dd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.210213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17848c-4871-41ef-aa15-7753472df7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.287672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cb17848c-4871-41ef-aa15-7753472df7dd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:59.288870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cb17848c-4871-41ef-aa15-7753472df7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:59.328142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.387911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:04:59.426224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccffd7-cacb-4519-aa1a-c132a71f1b31 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.427776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9bccffd7-cacb-4519-aa1a-c132a71f1b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:59.535150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccffd7-cacb-4519-aa1a-c132a71f1b31 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.581888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.617959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.618550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.618820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.619082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.620654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:59.733674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.735178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3def-d20f-4027-a67d-f7f7200b0ce6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.754177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 739/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:01.742161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e71cd-3f61-4f65-acfe-d2e818dcd1bf None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.742745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e71cd-3f61-4f65-acfe-d2e818dcd1bf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.742745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e71cd-3f61-4f65-acfe-d2e818dcd1bf None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.744049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:01.750916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488ea2-ceeb-4db5-8dc4-0f73a08f6348 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.751383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488ea2-ceeb-4db5-8dc4-0f73a08f6348 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.751499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488ea2-ceeb-4db5-8dc4-0f73a08f6348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.839719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-53488ea2-ceeb-4db5-8dc4-0f73a08f6348 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:01.840916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-53488ea2-ceeb-4db5-8dc4-0f73a08f6348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:01.859076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.943732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:01.981087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e71cd-3f61-4f65-acfe-d2e818dcd1bf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.983270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-756e71cd-3f61-4f65-acfe-d2e818dcd1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:02.091043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e71cd-3f61-4f65-acfe-d2e818dcd1bf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.166304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.174480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.175129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.175402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.175665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.177290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:02.290862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.292210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e39fe-77a5-41da-8684-008a880c833a service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.310230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 727/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:04.306186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7f5f-9024-4e27-9c72-ce0c613ae795 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.306827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7f5f-9024-4e27-9c72-ce0c613ae795 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.306827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7f5f-9024-4e27-9c72-ce0c613ae795 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.307990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:04.314494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee11a1a-2b0a-4e50-b177-b00296f8cbe7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.315286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee11a1a-2b0a-4e50-b177-b00296f8cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.315473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee11a1a-2b0a-4e50-b177-b00296f8cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.391312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4ee11a1a-2b0a-4e50-b177-b00296f8cbe7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:04.393157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4ee11a1a-2b0a-4e50-b177-b00296f8cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:04.443261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.493463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:04.532214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7f5f-9024-4e27-9c72-ce0c613ae795 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:04.533854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-970c7f5f-9024-4e27-9c72-ce0c613ae795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:04.640514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7f5f-9024-4e27-9c72-ce0c613ae795 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.690670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.722824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:04.723428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.723696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.723954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.725583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:04.837340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:04.838775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30b70-9aff-4cb3-a6d7-3025ee933039 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:04.856853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 742/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:14.491674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=22 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.854464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=66 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:24.004033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89d19-1f87-4759-a2e2-bc6d4ea7fdb0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.004664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89d19-1f87-4759-a2e2-bc6d4ea7fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.004664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89d19-1f87-4759-a2e2-bc6d4ea7fdb0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.005965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 729/1471] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:24.012313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da200-826b-4010-b37e-ad1607bbbacd None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.013095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da200-826b-4010-b37e-ad1607bbbacd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.013326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da200-826b-4010-b37e-ad1607bbbacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.089048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-dd5da200-826b-4010-b37e-ad1607bbbacd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:24.090268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dd5da200-826b-4010-b37e-ad1607bbbacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:24.198912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 743/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:24.291261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a72ff-0515-4646-95c7-07dc25cc4b76 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.291538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a72ff-0515-4646-95c7-07dc25cc4b76 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.291804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a72ff-0515-4646-95c7-07dc25cc4b76 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.293211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 730/1473] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 10 11:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:24.298221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43ca81-4897-4e4a-ae0f-c82631abc947 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.298502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43ca81-4897-4e4a-ae0f-c82631abc947 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.298766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43ca81-4897-4e4a-ae0f-c82631abc947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.378754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cc43ca81-4897-4e4a-ae0f-c82631abc947 None None] MFA Rules not processed for user `f1d18e6612024b4cbef06e5da57d4bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:24.379950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cc43ca81-4897-4e4a-ae0f-c82631abc947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:24.403139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:24.461119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 744/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 10 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:24.468703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a72ff-0515-4646-95c7-07dc25cc4b76 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:24.470254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e18a72ff-0515-4646-95c7-07dc25cc4b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:24.576586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a72ff-0515-4646-95c7-07dc25cc4b76 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:24.658247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:24.658838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.659108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.659372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.660922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:24.716797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:24.775437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:24.777365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba813c-3892-4084-8a43-bd768e14283a service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:24.798788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 731/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:26.847030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825f0b2-d135-49b9-945e-8fa2c74f8785 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.847901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825f0b2-d135-49b9-945e-8fa2c74f8785 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.847901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825f0b2-d135-49b9-945e-8fa2c74f8785 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.850163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 745/1476] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:26.856288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3947d8-3afd-4692-8917-c662c824ef7d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.856726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3947d8-3afd-4692-8917-c662c824ef7d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.856831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3947d8-3afd-4692-8917-c662c824ef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.925631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ce3947d8-3afd-4692-8917-c662c824ef7d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:26.926828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ce3947d8-3afd-4692-8917-c662c824ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:27.024632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 732/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:27.047924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825f0b2-d135-49b9-945e-8fa2c74f8785 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.049473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a825f0b2-d135-49b9-945e-8fa2c74f8785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:27.185116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825f0b2-d135-49b9-945e-8fa2c74f8785 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.236266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.282761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.283371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.283643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.283906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.284544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.286360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:05:27.286360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:05:27.286360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:05:27.287497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab62ea-c923-400e-ace1-80c36e2d99df admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.307683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 746/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:05:29.335309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77f11-a6f7-4768-8686-93719807bd6b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.336255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77f11-a6f7-4768-8686-93719807bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.336255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77f11-a6f7-4768-8686-93719807bd6b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.338374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 733/1479] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:29.346377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e119bdc-a639-4f27-9472-efd700689273 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.346797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e119bdc-a639-4f27-9472-efd700689273 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.346894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e119bdc-a639-4f27-9472-efd700689273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.417056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8e119bdc-a639-4f27-9472-efd700689273 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:29.418188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8e119bdc-a639-4f27-9472-efd700689273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:29.515422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 747/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:29.562777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab77f11-a6f7-4768-8686-93719807bd6b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.564357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8ab77f11-a6f7-4768-8686-93719807bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:29.578158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.719203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab77f11-a6f7-4768-8686-93719807bd6b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.811089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.843969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.844603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.844871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.845335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.846896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:29.947916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.949529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9dfdf-aa25-4686-be77-9f0dbd209879 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.967881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 734/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:32.187831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e23d-035a-4d17-ac49-a4d35a73c73a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.188479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e23d-035a-4d17-ac49-a4d35a73c73a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.188479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e23d-035a-4d17-ac49-a4d35a73c73a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.189897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 748/1482] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:32.195398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e0d4-6727-4881-a826-6b55dc5b9acc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.195843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e0d4-6727-4881-a826-6b55dc5b9acc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.195946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e0d4-6727-4881-a826-6b55dc5b9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.265780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4ca8e0d4-6727-4881-a826-6b55dc5b9acc None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:32.267014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4ca8e0d4-6727-4881-a826-6b55dc5b9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:32.316813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.370081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 735/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:32.407240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87e23d-035a-4d17-ac49-a4d35a73c73a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.408774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2e87e23d-035a-4d17-ac49-a4d35a73c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:32.435222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.524956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87e23d-035a-4d17-ac49-a4d35a73c73a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.610954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.611449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.611723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.612006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.613608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:32.688028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.724102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.725554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc9a73-2976-423b-94c2-257bb973fe88 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.744033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 749/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:34.771498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876d1aa-e50b-40ed-9797-b77df51055d4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.772376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876d1aa-e50b-40ed-9797-b77df51055d4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.772376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876d1aa-e50b-40ed-9797-b77df51055d4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.774820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 736/1485] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:34.781459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279527-489b-4e00-86ae-274bc4f4bb7f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.781963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279527-489b-4e00-86ae-274bc4f4bb7f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.782068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279527-489b-4e00-86ae-274bc4f4bb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.856272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c279527-489b-4e00-86ae-274bc4f4bb7f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:34.857550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c279527-489b-4e00-86ae-274bc4f4bb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:34.964087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 750/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:35.010319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876d1aa-e50b-40ed-9797-b77df51055d4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.011889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8876d1aa-e50b-40ed-9797-b77df51055d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:35.130673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876d1aa-e50b-40ed-9797-b77df51055d4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.203109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.204902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.205547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.205817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.206103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.208416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:35.321058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.322492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80422-736b-43d9-b73e-25368d0dc875 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.340631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 737/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:37.411483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc556-fee5-4e67-8b45-58a8583d18d1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.412364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc556-fee5-4e67-8b45-58a8583d18d1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.412364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc556-fee5-4e67-8b45-58a8583d18d1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.414434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 751/1488] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:37.422504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9eff1-14a1-45c9-838e-20a8dbbeec47 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.422975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9eff1-14a1-45c9-838e-20a8dbbeec47 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.423079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9eff1-14a1-45c9-838e-20a8dbbeec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.491321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5fd9eff1-14a1-45c9-838e-20a8dbbeec47 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:37.492547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5fd9eff1-14a1-45c9-838e-20a8dbbeec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:37.548304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:37.599993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 738/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:05:37.644105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dc556-fee5-4e67-8b45-58a8583d18d1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:37.645659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b93dc556-fee5-4e67-8b45-58a8583d18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:37.691507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:37.761946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dc556-fee5-4e67-8b45-58a8583d18d1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:37.837854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:37.838454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.838721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.838980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.840556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:37.935604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:37.969411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:37.970760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a616e-867c-4a25-880e-2e8c6da850f5 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:37.988853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 752/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:40.203998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623857b-121d-4a3d-a1f9-e4bca261ee19 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.204565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623857b-121d-4a3d-a1f9-e4bca261ee19 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.204565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623857b-121d-4a3d-a1f9-e4bca261ee19 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.206529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 739/1491] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 10 11:05:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:40.211940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79fe65-d7e9-4704-98e5-a618e46c4d64 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.212397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79fe65-d7e9-4704-98e5-a618e46c4d64 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.212509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79fe65-d7e9-4704-98e5-a618e46c4d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.278659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5e79fe65-d7e9-4704-98e5-a618e46c4d64 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:40.279858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5e79fe65-d7e9-4704-98e5-a618e46c4d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:40.379140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 753/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:05:40.421251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623857b-121d-4a3d-a1f9-e4bca261ee19 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:40.422824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b623857b-121d-4a3d-a1f9-e4bca261ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:40.533280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623857b-121d-4a3d-a1f9-e4bca261ee19 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:40.614108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:40.614719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.614989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.615251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.616840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:40.626903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:40.729541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:40.730966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced8332-a2e8-435e-88a1-5fa23d544306 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:40.749260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 740/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:05:50.377451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=82 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:50.746567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=50 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:51.371243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:51.372192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:51.372192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:51.460727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:51.462565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:51.570355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 754/1494] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:06:51.578957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:51.579475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:51.579475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:51.660643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:51.661865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:51.767759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 741/1495] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:06:51.772702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:51.773976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:51.785551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff2d62-400c-4d9c-97b3-a09a1188aa64 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:51.853833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:51.896782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:51.897414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:51.897685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:51.897942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:51.898578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:51.898877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:51.899897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:51.899897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:06:51.899897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:06:51.900787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:51.912134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 755/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:06:51.920949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:51.930541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf289e-fd72-43eb-89a8-aa157277dd69 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:51.998614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:52.034458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:52.035064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.035334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.035595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.036223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:52.038001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:52.038001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:06:52.038001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:06:52.039172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:52.095807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 742/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:06:51 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:06:52.100357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:52.102221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:52.137590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8de7-a4e0-4d3c-b736-c539da97ed5f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:52.233194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:52.233803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.234080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.234342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.234975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:52.235995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:52.235995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:06:52.235995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:06:52.237319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:52.281814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 756/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:06:52 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:06:52.286278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:52.287764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:52.357071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86459-4544-4bc3-8d4a-2ae7a632e58b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:52.449732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:52.461776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:52.462391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.462666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.462925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.463567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:52.464604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:52.464604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:06:52.464604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:06:52.465529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:52.478168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 743/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:06:52.482465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:52.484034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:52.495679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12a5c-2659-4661-adbd-28a376426085 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:52.523157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:52.596614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:52.597178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.597451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.597716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.598355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:52.599380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:52.599380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:06:52.599380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:06:52.600262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d41f75-30c1-4cec-956b-478f24f41838 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:52.612740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 757/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:06:52.617344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:52.618900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:52.653541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae409bb-13cf-4201-a6e0-89bf038ea69e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:52.754563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:52.755216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.755485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.755745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] PATH_INFO: `/v3/projects/212c2fda21544937b58f1658bb3be588/users/4a7ba871a2354f93b1888f568e1fbc1e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.777149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212c2fda21544937b58f1658bb3be588, user_id=4a7ba871a2354f93b1888f568e1fbc1e, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:52.778168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:52.778168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:06:52.778168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:06:52.780096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226bf3c-e3eb-4997-8060-72dc727cb572 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:52.808877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 744/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:06:52 2022] PUT /identity/v3/projects/212c2fda21544937b58f1658bb3be588/users/4a7ba871a2354f93b1888f568e1fbc1e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:06:52.822328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99f873-5a5c-4ea3-8437-3d6ecbe78ec5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.822660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99f873-5a5c-4ea3-8437-3d6ecbe78ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.823004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99f873-5a5c-4ea3-8437-3d6ecbe78ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.886067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5a99f873-5a5c-4ea3-8437-3d6ecbe78ec5 None None] MFA Rules not processed for user `4a7ba871a2354f93b1888f568e1fbc1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:52.887179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5a99f873-5a5c-4ea3-8437-3d6ecbe78ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:52.967823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 758/1502] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:06:52.983289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e42e8-03f2-4288-80ae-7271a7a22489 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.983568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e42e8-03f2-4288-80ae-7271a7a22489 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.983811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e42e8-03f2-4288-80ae-7271a7a22489 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:52.985217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 745/1503] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 10 11:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:52.990320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff5d8-2387-4f42-862b-7fa489aa484a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:52.990605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff5d8-2387-4f42-862b-7fa489aa484a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:52.990880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff5d8-2387-4f42-862b-7fa489aa484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:53.022835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:53.078744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a4aff5d8-2387-4f42-862b-7fa489aa484a None None] MFA Rules not processed for user `b1604862a92742d8bd8d1ca837a63c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:53.079946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a4aff5d8-2387-4f42-862b-7fa489aa484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:53.158123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 759/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 10 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:06:53.165998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e42e8-03f2-4288-80ae-7271a7a22489 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:53.167494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d17e42e8-03f2-4288-80ae-7271a7a22489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:53.224135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:53.288251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e42e8-03f2-4288-80ae-7271a7a22489 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:53.373032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:53.373666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:53.373930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:53.374189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:53.375756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:53.477204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:53.478564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:53.481946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:53.496583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 746/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:06:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:06:53.542227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ffa05-8c3d-4d91-a60a-85005c4a278c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:53.542654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ffa05-8c3d-4d91-a60a-85005c4a278c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:53.542803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ffa05-8c3d-4d91-a60a-85005c4a278c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:53.544064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 760/1506] 10.222.0.42 () {52 vars in 830 bytes} [Wed Aug 10 11:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:53.547804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:53.549241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:53.651919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57505ee-10d4-424e-8b29-9654b84c5402 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:53.747844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:53.748394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:53.748645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:53.748945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] PATH_INFO: `/v3/users/4a7ba871a2354f93b1888f568e1fbc1e` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:53.762526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7ba871a2354f93b1888f568e1fbc1e)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:53.763552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:53.763552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:06:53.763552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:06:53.764764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:53.774607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:53.831712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7ba871a2354f93b1888f568e1fbc1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:53.855430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7ba871a2354f93b1888f568e1fbc1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:53.869652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7ba871a2354f93b1888f568e1fbc1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:53.870199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7ba871a2354f93b1888f568e1fbc1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:53.870606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7ba871a2354f93b1888f568e1fbc1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:53.889989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 747/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:06:53 2022] DELETE /identity/v3/users/4a7ba871a2354f93b1888f568e1fbc1e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:06:53.895824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:53.896098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:53.896367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:53.956677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:53.957921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:54.039423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:54.053416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 761/1508] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:06:54.064034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:54.065477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:54.170121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299711d-839b-43f5-b366-b947de0ce5eb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:54.234428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:54.255803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:54.256342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:54.256613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:54.256876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:54.258483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:54.377458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:54.378900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16b2d-9791-4c89-9baf-a9b45b42b483 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:54.397579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 748/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:06:54.735152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:54.736420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:54.748294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f92ff-c872-4467-9771-f0ca7d612f09 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:54.853710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:54.854337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:54.854603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:54.854861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] PATH_INFO: `/v3/projects/212c2fda21544937b58f1658bb3be588` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:54.865119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212c2fda21544937b58f1658bb3be588)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:54.866149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:54.866149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:06:54.866149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:06:54.867334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:54.928924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212c2fda21544937b58f1658bb3be588', 'request_id': 'req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:54.942722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212c2fda21544937b58f1658bb3be588', 'request_id': 'req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:54.955494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212c2fda21544937b58f1658bb3be588', 'request_id': 'req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:54.980256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] The token cache is being invalidate because project 212c2fda21544937b58f1658bb3be588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:06:54.980515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:54.981064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9cc9ab34-e609-4f5c-a95c-f678529ee2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:06:54.982395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 762/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:06:54 2022] DELETE /identity/v3/projects/212c2fda21544937b58f1658bb3be588 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:07:04.395272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=62 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:04.977679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:32.508155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d585a-ff01-45cf-8edf-5e80f400b321 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:32.508941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d585a-ff01-45cf-8edf-5e80f400b321 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:32.508941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d585a-ff01-45cf-8edf-5e80f400b321 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:32.510774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:32.515912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8ae0e-66c4-4b91-97f7-b18e171333b7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:32.516444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8ae0e-66c4-4b91-97f7-b18e171333b7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:32.516444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8ae0e-66c4-4b91-97f7-b18e171333b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:32.598502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ede8ae0e-66c4-4b91-97f7-b18e171333b7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:32.599671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ede8ae0e-66c4-4b91-97f7-b18e171333b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:32.711026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:32.866722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d585a-ff01-45cf-8edf-5e80f400b321 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:32.869337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-803d585a-ff01-45cf-8edf-5e80f400b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:32.996723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d585a-ff01-45cf-8edf-5e80f400b321 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:33.003231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7ebad-af1d-43c1-8371-3ee017adb8b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:33.003834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ebad-af1d-43c1-8371-3ee017adb8b8 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:33.004110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ebad-af1d-43c1-8371-3ee017adb8b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:33.004375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ebad-af1d-43c1-8371-3ee017adb8b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:33.012920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7ebad-af1d-43c1-8371-3ee017adb8b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:33.014558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7ebad-af1d-43c1-8371-3ee017adb8b8 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:33.025249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 750/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:33.850689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b2e06-a94b-48a8-a7ec-9916b5320b33 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:33.851289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b2e06-a94b-48a8-a7ec-9916b5320b33 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:33.851289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b2e06-a94b-48a8-a7ec-9916b5320b33 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:33.852594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:33.858579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2ab9a-e19f-4153-a43a-732be25d5c9b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:33.859363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2ab9a-e19f-4153-a43a-732be25d5c9b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:33.859475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2ab9a-e19f-4153-a43a-732be25d5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:33.885406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1bc2ab9a-e19f-4153-a43a-732be25d5c9b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:33.886605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1bc2ab9a-e19f-4153-a43a-732be25d5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:33.895000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:34.048243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b2e06-a94b-48a8-a7ec-9916b5320b33 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:34.063895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b2e06-a94b-48a8-a7ec-9916b5320b33 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:34.070052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764c46-460c-4cc7-95cd-48d3b5d4bd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:34.070644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764c46-460c-4cc7-95cd-48d3b5d4bd85 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:34.070922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764c46-460c-4cc7-95cd-48d3b5d4bd85 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:34.071186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764c46-460c-4cc7-95cd-48d3b5d4bd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:34.079794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764c46-460c-4cc7-95cd-48d3b5d4bd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:34.081445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764c46-460c-4cc7-95cd-48d3b5d4bd85 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:34.090776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 765/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:08:34.640593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f275c-1d02-43a4-a428-a6b2e02ff214 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:34.640881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f275c-1d02-43a4-a428-a6b2e02ff214 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:34.641154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f275c-1d02-43a4-a428-a6b2e02ff214 None None] PATH_INFO: `/v3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:34.642567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 752/1517] 10.222.0.44 () {54 vars in 925 bytes} [Wed Aug 10 11:08:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:34.649650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922fb9b-7653-41de-8320-b384fc8ccb20 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:34.649924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922fb9b-7653-41de-8320-b384fc8ccb20 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:34.650188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922fb9b-7653-41de-8320-b384fc8ccb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:34.710104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2922fb9b-7653-41de-8320-b384fc8ccb20 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:34.711286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2922fb9b-7653-41de-8320-b384fc8ccb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:34.733337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:34.790680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 766/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Wed Aug 10 11:08:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:38.691249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8735-4917-45ab-8e94-759565d49941 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:38.692012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8735-4917-45ab-8e94-759565d49941 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:38.692145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8735-4917-45ab-8e94-759565d49941 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:38.694176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 753/1519] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 10 11:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:38.702783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cc55f-5126-42e7-b762-17c630b9bff4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:38.703522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cc55f-5126-42e7-b762-17c630b9bff4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:38.703702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cc55f-5126-42e7-b762-17c630b9bff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:38.724075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-525cc55f-5126-42e7-b762-17c630b9bff4 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:38.725314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-525cc55f-5126-42e7-b762-17c630b9bff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:38.734494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 767/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 10 11:08:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:38.742311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8735-4917-45ab-8e94-759565d49941 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:38.758666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8735-4917-45ab-8e94-759565d49941 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:38.764654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfe9ac-7257-4dfd-898f-414d914146f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:38.765312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfe9ac-7257-4dfd-898f-414d914146f0 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:38.765588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfe9ac-7257-4dfd-898f-414d914146f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:38.765856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfe9ac-7257-4dfd-898f-414d914146f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:38.774359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfe9ac-7257-4dfd-898f-414d914146f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:38.776205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfe9ac-7257-4dfd-898f-414d914146f0 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:38.785868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 754/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:45.349310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8d30-376c-4232-adb8-30a0afa767d5 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:45.350250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8d30-376c-4232-adb8-30a0afa767d5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:45.350250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8d30-376c-4232-adb8-30a0afa767d5 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:45.352612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:08:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:45.358979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f89a63-cf1d-475d-8bd3-ff2eae0a2ab5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:45.359455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f89a63-cf1d-475d-8bd3-ff2eae0a2ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:45.359579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f89a63-cf1d-475d-8bd3-ff2eae0a2ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:45.381726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-72f89a63-cf1d-475d-8bd3-ff2eae0a2ab5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:45.382934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-72f89a63-cf1d-475d-8bd3-ff2eae0a2ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:45.392902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:45.546738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8d30-376c-4232-adb8-30a0afa767d5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:45.562189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8d30-376c-4232-adb8-30a0afa767d5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:45.568132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60564b4-f89c-4193-9ea5-fe7172ad601e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:45.568738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60564b4-f89c-4193-9ea5-fe7172ad601e service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:45.569007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60564b4-f89c-4193-9ea5-fe7172ad601e service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:45.569294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60564b4-f89c-4193-9ea5-fe7172ad601e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:45.577570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60564b4-f89c-4193-9ea5-fe7172ad601e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:45.579150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60564b4-f89c-4193-9ea5-fe7172ad601e service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:45.588683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 769/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:46.403744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b7076-623f-4691-b56b-1048078608c4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:46.404579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b7076-623f-4691-b56b-1048078608c4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:46.404579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b7076-623f-4691-b56b-1048078608c4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:46.406661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:46.411917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b179d7-3c52-4a66-b1fb-e85f5123e19f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:46.412353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b179d7-3c52-4a66-b1fb-e85f5123e19f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:46.412481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b179d7-3c52-4a66-b1fb-e85f5123e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:46.433578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c0b179d7-3c52-4a66-b1fb-e85f5123e19f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:46.434781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c0b179d7-3c52-4a66-b1fb-e85f5123e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:46.447424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:46.600792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b7076-623f-4691-b56b-1048078608c4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:46.617812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b7076-623f-4691-b56b-1048078608c4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:46.625377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c05618-8264-4767-b9bf-86584e66ace9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:46.625969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c05618-8264-4767-b9bf-86584e66ace9 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:46.626242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c05618-8264-4767-b9bf-86584e66ace9 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:46.626505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c05618-8264-4767-b9bf-86584e66ace9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:46.635878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c05618-8264-4767-b9bf-86584e66ace9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:46.637507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c05618-8264-4767-b9bf-86584e66ace9 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:46.647993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 757/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:50.697079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645729-23e6-4259-b763-5c9d9d0a179f None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:50.697929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645729-23e6-4259-b763-5c9d9d0a179f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:50.698068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645729-23e6-4259-b763-5c9d9d0a179f None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:50.700105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:50.706391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48806a14-24d6-4a81-818f-22d5c0b8042c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:50.707144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48806a14-24d6-4a81-818f-22d5c0b8042c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:50.707273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48806a14-24d6-4a81-818f-22d5c0b8042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:50.735869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-48806a14-24d6-4a81-818f-22d5c0b8042c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:50.737109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-48806a14-24d6-4a81-818f-22d5c0b8042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:50.746206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:50.830725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645729-23e6-4259-b763-5c9d9d0a179f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:50.833011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c9645729-23e6-4259-b763-5c9d9d0a179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:50.918889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645729-23e6-4259-b763-5c9d9d0a179f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:50.922909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c742d8-4359-44d3-919a-1b4fde7891c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:50.923502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c742d8-4359-44d3-919a-1b4fde7891c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:50.923784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c742d8-4359-44d3-919a-1b4fde7891c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:50.924032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c742d8-4359-44d3-919a-1b4fde7891c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:50.933111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c742d8-4359-44d3-919a-1b4fde7891c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:50.934541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c742d8-4359-44d3-919a-1b4fde7891c5 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:50.943818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 772/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:52.911087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72180e-e5d4-4a10-a9a3-fff96bd614ec None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:52.911954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72180e-e5d4-4a10-a9a3-fff96bd614ec None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:52.911954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72180e-e5d4-4a10-a9a3-fff96bd614ec None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:52.914089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:08:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:52.919775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869116-1a18-42e7-b759-91ddb5a7cedc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:52.920217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869116-1a18-42e7-b759-91ddb5a7cedc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:52.920330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869116-1a18-42e7-b759-91ddb5a7cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:52.940409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f6869116-1a18-42e7-b759-91ddb5a7cedc None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:52.941620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6869116-1a18-42e7-b759-91ddb5a7cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:52.950103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:52.989478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72180e-e5d4-4a10-a9a3-fff96bd614ec None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:53.008611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72180e-e5d4-4a10-a9a3-fff96bd614ec None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:53.012966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b15f4-a2fd-4f77-b1cd-e36d83442c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:53.013586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b15f4-a2fd-4f77-b1cd-e36d83442c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:53.013856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b15f4-a2fd-4f77-b1cd-e36d83442c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:53.014118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b15f4-a2fd-4f77-b1cd-e36d83442c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:53.023046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b15f4-a2fd-4f77-b1cd-e36d83442c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:53.024473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b15f4-a2fd-4f77-b1cd-e36d83442c68 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:53.033715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 760/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:56.732294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd0f4-9374-4a03-85c8-d6d7cffeaded None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:56.733205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd0f4-9374-4a03-85c8-d6d7cffeaded None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:56.733205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd0f4-9374-4a03-85c8-d6d7cffeaded None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:56.735426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:56.744178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c030c4f-81b1-4e90-aa2b-19b82243fd3a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:56.744599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c030c4f-81b1-4e90-aa2b-19b82243fd3a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:56.744813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c030c4f-81b1-4e90-aa2b-19b82243fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:56.758923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=81 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:56.772738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4c030c4f-81b1-4e90-aa2b-19b82243fd3a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:56.773985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4c030c4f-81b1-4e90-aa2b-19b82243fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:56.782825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:57.086374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd0f4-9374-4a03-85c8-d6d7cffeaded None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:57.088474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-972dd0f4-9374-4a03-85c8-d6d7cffeaded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:57.162268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:57.176267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd0f4-9374-4a03-85c8-d6d7cffeaded None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:57.180376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b0363-8f51-4ecc-b529-7d0eaf21bdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:57.181021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0363-8f51-4ecc-b529-7d0eaf21bdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:57.181295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0363-8f51-4ecc-b529-7d0eaf21bdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:57.181575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0363-8f51-4ecc-b529-7d0eaf21bdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:57.195525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b0363-8f51-4ecc-b529-7d0eaf21bdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:57.198244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b0363-8f51-4ecc-b529-7d0eaf21bdd2 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:57.214076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 775/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:08:59.188890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c492-0d3a-45d0-b377-d1d332148873 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:59.189753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c492-0d3a-45d0-b377-d1d332148873 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:59.189923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c492-0d3a-45d0-b377-d1d332148873 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:59.192117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:08:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:59.198531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a133ad-42bc-4d3a-9f31-48711008b790 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:59.199261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a133ad-42bc-4d3a-9f31-48711008b790 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:59.199414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a133ad-42bc-4d3a-9f31-48711008b790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:59.226274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f6a133ad-42bc-4d3a-9f31-48711008b790 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:59.227470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6a133ad-42bc-4d3a-9f31-48711008b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:59.235849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:08:59.537719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c492-0d3a-45d0-b377-d1d332148873 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:59.541027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c940c492-0d3a-45d0-b377-d1d332148873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:59.561298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c492-0d3a-45d0-b377-d1d332148873 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:59.565643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c421-41e1-4119-be22-1db9573800cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:59.566241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c421-41e1-4119-be22-1db9573800cb service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:59.566512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c421-41e1-4119-be22-1db9573800cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:59.566785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c421-41e1-4119-be22-1db9573800cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:59.576509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1c421-41e1-4119-be22-1db9573800cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:59.577971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1c421-41e1-4119-be22-1db9573800cb service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:59.588549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 763/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:09:09.219788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=11 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:09:09.583815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=8 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:28.267640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739878-ce80-4b20-996e-869352285b19 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.269046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739878-ce80-4b20-996e-869352285b19 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.269046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739878-ce80-4b20-996e-869352285b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.292204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03a1a6-f53a-49d4-9f6b-8d957bf58dd8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.293282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03a1a6-f53a-49d4-9f6b-8d957bf58dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.293895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03a1a6-f53a-49d4-9f6b-8d957bf58dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.296955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0c739878-ce80-4b20-996e-869352285b19 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.298851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c739878-ce80-4b20-996e-869352285b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.317363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 777/1540] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.318630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d83d7-aa3b-4bcc-bf1e-069e9c980b68 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.318912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d83d7-aa3b-4bcc-bf1e-069e9c980b68 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.319333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d83d7-aa3b-4bcc-bf1e-069e9c980b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.321339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1f03a1a6-f53a-49d4-9f6b-8d957bf58dd8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.322553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1f03a1a6-f53a-49d4-9f6b-8d957bf58dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.337892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 764/1541] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:28.339907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.340190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.340460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.354102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-975d83d7-aa3b-4bcc-bf1e-069e9c980b68 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.355320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-975d83d7-aa3b-4bcc-bf1e-069e9c980b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.373093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 778/1542] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.374272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.374471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8eceaf-aa10-48f0-a217-50f0394e4509 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.374743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8eceaf-aa10-48f0-a217-50f0394e4509 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.375013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8eceaf-aa10-48f0-a217-50f0394e4509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.375491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.391230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 765/1543] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:28.395854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.409139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8e8eceaf-aa10-48f0-a217-50f0394e4509 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.410418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8e8eceaf-aa10-48f0-a217-50f0394e4509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.411669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1243ae5-74cf-4df8-8e28-56eda30b60f2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.422765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.423397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.423664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.424019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.424946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:28.425359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.426725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:28.426725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:10:28.426725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:10:28.427718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cbc1e-f384-476b-9788-b3495303fecf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.429932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 779/1544] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.431039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.431316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.431581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.457369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 766/1545] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:28.459159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.459659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.460130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.478083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.479565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.489542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.491207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.493830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 780/1546] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.498619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.504876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 767/1547] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.509017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.509158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032b59a-1903-44a6-9e05-91970aacb617 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.510500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.511102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.511378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.511887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.512787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:28.512907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.514446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0aab3-00a2-494b-8c33-9ef7986a926d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.516865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd5c3-8ae6-4c62-b299-cf538d4ecd49 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.521618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.522221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.522487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.522743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.523361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.525276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.527894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 781/1548] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:28.529157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401d6f-52ae-4257-86d0-afa3174088ed None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.529463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401d6f-52ae-4257-86d0-afa3174088ed None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.529721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401d6f-52ae-4257-86d0-afa3174088ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.548335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2c401d6f-52ae-4257-86d0-afa3174088ed None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.549612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2c401d6f-52ae-4257-86d0-afa3174088ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.559147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 782/1549] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.560560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43b5d-92a5-4adf-a3aa-6bb1b8fe1fe5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.560836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43b5d-92a5-4adf-a3aa-6bb1b8fe1fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.561150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43b5d-92a5-4adf-a3aa-6bb1b8fe1fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.568661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 768/1550] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:28.568661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.583693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-afe43b5d-92a5-4adf-a3aa-6bb1b8fe1fe5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.584913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-afe43b5d-92a5-4adf-a3aa-6bb1b8fe1fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.628700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fd6c-f191-4282-8a12-310ef880255a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.633453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.634076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.634346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.634608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.635241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:28.635536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.637149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774b2b-bd86-4741-a5ce-d8ee460246f1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.643093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 783/1551] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.644503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a359b8-c6b8-4bb5-b0d4-0cba35270501 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.644776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a359b8-c6b8-4bb5-b0d4-0cba35270501 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.645069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a359b8-c6b8-4bb5-b0d4-0cba35270501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.663457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 769/1552] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:28.663457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.663457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.663457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.664624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d1a359b8-c6b8-4bb5-b0d4-0cba35270501 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.665858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d1a359b8-c6b8-4bb5-b0d4-0cba35270501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.674006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 784/1553] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.675234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487890b5-e481-4b94-9bfb-a7ec8281f45e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.675516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487890b5-e481-4b94-9bfb-a7ec8281f45e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.675789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487890b5-e481-4b94-9bfb-a7ec8281f45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.682892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.685071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.693678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 770/1554] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.694428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.695205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-487890b5-e481-4b94-9bfb-a7ec8281f45e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.696405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-487890b5-e481-4b94-9bfb-a7ec8281f45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.703451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09fdb4-59c1-48c2-8ff8-91923a375e60 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.706392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 785/1555] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.707623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.707885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.708150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.715408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ffca7-0b37-4626-884a-c2a0e5c8ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.716225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ffca7-0b37-4626-884a-c2a0e5c8ac16 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.717180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ffca7-0b37-4626-884a-c2a0e5c8ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.717463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ffca7-0b37-4626-884a-c2a0e5c8ac16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.718092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ffca7-0b37-4626-884a-c2a0e5c8ac16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.719994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ffca7-0b37-4626-884a-c2a0e5c8ac16 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.727546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.728750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.737142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 786/1556] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.738092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.751729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 771/1557] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:28.751934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2df62-f921-47a2-bf5e-392545e9b876 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.752031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cae73-6c47-489d-9aa6-dc93bdf777cb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.752031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cae73-6c47-489d-9aa6-dc93bdf777cb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.752031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cae73-6c47-489d-9aa6-dc93bdf777cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.769021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ac1cae73-6c47-489d-9aa6-dc93bdf777cb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.770206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ac1cae73-6c47-489d-9aa6-dc93bdf777cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.803690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.804302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.804571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.804862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.805512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.807505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.831777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 787/1558] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:28.832178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 772/1559] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.832580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.833474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.833756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.834011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.841499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:28.843851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d9bc1-d91f-4c15-8034-eef100077bae admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.849772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.850372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.850639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.850902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.851542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.852610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:28.852610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:10:28.852610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:10:28.853818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10e3cc-d577-4119-b1d9-6ffe9b4088de admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.854391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.855567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.863837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 773/1560] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.864442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.874306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841ea94-5cba-4641-a236-8e45117afe9e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.879137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.879720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.879990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.880250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.880881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:28.881205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.885925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 788/1561] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:28.886095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.886202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.886202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.886202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.891793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:28.897604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 774/1562] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:28.898357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.908137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a324354-8b56-4848-9752-4dc7d87b0c60 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.912371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:28.913588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:28.962707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.963300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.963564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.963823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.964448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:28.964736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.966346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.970351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 789/1563] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:28.970935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.986100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 775/1564] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:28.986299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa7f4-e146-41d1-99d3-989b13fba8a7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.986400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:28.986491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.986491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.986491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.986491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.986804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:28.987891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:28.992489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b53f-8909-4722-b0b1-f6867e7c6129 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:28.997589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:28.998181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:28.998452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:28.998705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:28.999341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.000948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.011499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 790/1565] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:28 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.015535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 776/1566] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.015695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.015807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.022672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92a786-7620-4297-9558-42115c08d749 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.025576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68772eae-2f52-4d04-9b5f-9724f5523d9a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.028285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.028900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.029222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.029487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.030137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:29.030436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.030590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.031263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.031555 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.031818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.032135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.032445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:29.032736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.035169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.044576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 791/1567] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:29.045363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.052031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 777/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:29.052866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.055333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edf81-b898-4139-93bc-14609a1a2f42 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.063312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418dbae-efe2-4f67-9c43-86d712dd048e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.063732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.064339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.064606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.064865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.065562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.067537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.068903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.069676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.069960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.070226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.070839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.072740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.091894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 792/1569] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.093454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.103433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 778/1570] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.104238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.108711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454170-e873-47f2-99cc-03e0e064ad1f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.169204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.169723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.169997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.170255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.170900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:29.171195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.172838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.173346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4980-6b3b-4ba6-bd8a-f4f227655fcd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.178649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.179249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.179491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.179771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.180386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.182301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.184757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 793/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:29.191353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.197001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee88c9-9fa8-4801-a10b-1b43bae4bc69 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.201856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.202759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.202759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.202949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.203605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.205191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.214773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 779/1572] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.215436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.219704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 794/1573] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.219704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.229792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbf405-82d1-42f0-84d2-08d1daed05b7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.235386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:29.262618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:29.282286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9de441-456c-4999-beb9-9264ee30e3d7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.286111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.286723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.286955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.287234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.287414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.287851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.288021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.288293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.288557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.289225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.289806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.290807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.301104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 780/1574] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.301972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.311261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78656-23ea-4ddd-ac80-df79fec2571b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.316271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.316846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.317148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.317413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.318016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.319915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.323510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 795/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.323510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.354288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 781/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.354288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.385095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf51be-b37b-4114-99c8-3b02d6de9a7d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.413016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408caa02-db32-4d83-9429-5dc3cacf96c0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.417724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.418478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.418782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.419026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.419668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.420763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:29.420763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:10:29.420763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:10:29.421977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.442630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.443239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.443510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.443930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.447195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 782/1577] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.447333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.447428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.447516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.455144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d2e2-ba08-47c9-a199-423a74dc9ef8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.456236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 796/1578] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.457139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.460852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.461490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.461798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.462103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.463210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.464641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.466296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9a3f-1ba6-4fa6-a5ae-dec73f58a397 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.470886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.471492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.471765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.472105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.472734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.474726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.492984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 783/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.493904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.498938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 797/1580] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.498938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.506735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1b7b3-407c-48c4-8c47-d9bdce6c2a3a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.548942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:29.551653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:29.555339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268751a6-e745-4538-aa55-f0daf6eb775a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.560889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.561625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.561942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.562397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.563164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.564894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.565041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.565587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.565917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.566185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] PATH_INFO: `/v3/projects/11a4f6a83bb5417ba9d10c3cba2c268f/users/712719c343b547699f7cdbe9c178db5f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.575651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 784/1581] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.576535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.584410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a4f6a83bb5417ba9d10c3cba2c268f, user_id=712719c343b547699f7cdbe9c178db5f, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.585490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:29.585490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:10:29.585490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:10:29.586005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cd029-428d-4009-8156-bd14779a0119 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.587405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.590599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.591178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.591450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.591715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.592361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.594376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.611767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 798/1582] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:29 2022] PUT /identity/v3/projects/11a4f6a83bb5417ba9d10c3cba2c268f/users/712719c343b547699f7cdbe9c178db5f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:29.611767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.629297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 785/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.630209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.639523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cf7e6-5892-46c6-9ec1-84cb79759e50 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.662922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09531-8f5f-49f7-9b7b-a2a5322c0040 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.667766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.668400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.668644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.668899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.669537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.671510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.691781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 799/1584] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.692734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.696906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.697563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.697836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.698098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.698771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.700369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.702051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad1f4-7cb8-41b7-8132-06b30339551f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.706593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.707176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.707431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.707692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.708317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.709912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.710773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 786/1585] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.711447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.720937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64ae3-5e8b-478a-a2f8-c0a077b92711 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.722668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 800/1586] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.723585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.727498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.728096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.728473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.728740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.729409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.731238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.733003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c49eb4-03a2-4bb8-96b0-321eb46dda91 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.737558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9535-8fa1-49b3-839f-059982412731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.738130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9535-8fa1-49b3-839f-059982412731 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.738399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9535-8fa1-49b3-839f-059982412731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.738661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9535-8fa1-49b3-839f-059982412731 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.739264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9535-8fa1-49b3-839f-059982412731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.741162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9535-8fa1-49b3-839f-059982412731 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.742037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 787/1587] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.743004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.754387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5f2f7-289e-47a9-9034-f0097f1d27fc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.759772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.760413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.760689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.760954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] PATH_INFO: `/v3/projects/bbf759ed74a34385960c4020e7b67253/users/8444840f533b49049766f90d86c28d97/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.765057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 801/1588] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:29.766462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.766742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.767009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.775965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf759ed74a34385960c4020e7b67253, user_id=8444840f533b49049766f90d86c28d97, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.779057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.794182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] MFA Rules not processed for user `712719c343b547699f7cdbe9c178db5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:29.794411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 788/1589] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:29 2022] PUT /identity/v3/projects/bbf759ed74a34385960c4020e7b67253/users/8444840f533b49049766f90d86c28d97/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:29.795254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.795445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:29.859170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66f96e-9638-4453-ad63-e620fd6701b6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.863735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.864321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.864600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.864915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.865581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.866501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 802/1590] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:29.867208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.867380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.878954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228376-f5ee-410b-ba19-486bfea86498 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.879247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 789/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.879247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.883905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.884513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.884789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.885085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.885729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.887396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.888125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4f164-43f8-4de5-83b1-430a3b218650 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.892821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.893427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.893705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.894036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.894663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.896231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.897568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 803/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.898335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.906621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 790/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.907428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.913238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99854-492f-4a3c-aa8d-37f6acc8517a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.916592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87aef3-787c-4d15-9885-5b70e5863fc2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.917747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a879dba-2ba7-4e29-9cc0-2542e65abb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.918390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a879dba-2ba7-4e29-9cc0-2542e65abb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.918662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a879dba-2ba7-4e29-9cc0-2542e65abb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.918926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a879dba-2ba7-4e29-9cc0-2542e65abb88 admin admin] PATH_INFO: `/v3/projects/467786e761c74fb8a9822ecbaa3f4142/users/95398f8ac1ca42c0969b37f54a582e65/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.921029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.921671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.921871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.922138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.922758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.924354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.927507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:29.934956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a879dba-2ba7-4e29-9cc0-2542e65abb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467786e761c74fb8a9822ecbaa3f4142, user_id=95398f8ac1ca42c0969b37f54a582e65, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.935252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 791/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.936049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.941714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a879dba-2ba7-4e29-9cc0-2542e65abb88 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.945297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10680f6c-c7dc-4571-99f7-c118eef57978 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.950310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:29.950886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.951176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.951507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.952235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:29.953956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:29.955778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 804/1595] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:29 2022] PUT /identity/v3/projects/467786e761c74fb8a9822ecbaa3f4142/users/95398f8ac1ca42c0969b37f54a582e65/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:29.957187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:29.957462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:29.957727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:29.959918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:29.968232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 792/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:29.969278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:29.979225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06ae2b-8088-4530-9ad4-e81ba7feee25 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:29.985881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] MFA Rules not processed for user `8444840f533b49049766f90d86c28d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:29.987083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.033569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.034190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.034479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.034742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.035361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.037268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.054140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 805/1597] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.054140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.062195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fea9bb-6b76-43e9-94cf-7c4322ffe98e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.066699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.067294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.067568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.067834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.067936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 793/1598] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:29 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:30.068471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.068734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.070111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.083712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 806/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:30.083712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.090426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0994-d314-4591-811c-fe89f1d45285 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.134617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33580-c5ff-439b-9df0-8943cab10ec6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.139793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.140405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.140674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.140932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.141603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.143201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.147455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039e11-191b-43bd-9eb7-5d21e733a364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.148097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039e11-191b-43bd-9eb7-5d21e733a364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.148370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039e11-191b-43bd-9eb7-5d21e733a364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.148637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039e11-191b-43bd-9eb7-5d21e733a364 admin admin] PATH_INFO: `/v3/projects/124fbb2ac706401bb9511568ea4dbe67/users/d01d3fdea0f9451e8301003c34734569/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.153490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 794/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:30.154519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.164399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1369e7e-0ea0-4323-8557-9bcb5ec9698a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.164630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d039e11-191b-43bd-9eb7-5d21e733a364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124fbb2ac706401bb9511568ea4dbe67, user_id=d01d3fdea0f9451e8301003c34734569, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.167337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d039e11-191b-43bd-9eb7-5d21e733a364 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.169186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.169810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.170108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.170345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] PATH_INFO: `/v3/projects/23dec40c4f48493095c4ce6ed13270f4/users/714fa7c7cbb04714ab3fa140d3279f30/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.182632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 807/1601] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:30 2022] PUT /identity/v3/projects/124fbb2ac706401bb9511568ea4dbe67/users/d01d3fdea0f9451e8301003c34734569/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:30.183881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.184247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.184578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.190163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dec40c4f48493095c4ce6ed13270f4, user_id=714fa7c7cbb04714ab3fa140d3279f30, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.192935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.202941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.204279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.206834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 795/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:30 2022] PUT /identity/v3/projects/23dec40c4f48493095c4ce6ed13270f4/users/714fa7c7cbb04714ab3fa140d3279f30/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:30.207616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.257382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:30.265026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:30.269014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a32d75-9221-4d41-8cc4-84483c06588d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.273623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 808/1603] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.274436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.278782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.279468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.279746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.280010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.280656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.282466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.284267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58efa4-3ac5-4be5-a33f-97eaaf30574b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.289452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.290062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.290303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.290571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.291188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.292748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 796/1604] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:30.293119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.293629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.305066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55745-3d63-4afd-8f28-30d4478ba5aa admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.310226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.310818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.311093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.311357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.311969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.313945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.323599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 809/1605] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:30.323599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.335431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 797/1606] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:30.337857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.347437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52546-400c-426c-9fcd-4d6711fa53ee admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.387790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab067a6-b103-4fde-bc00-c094e8c53032 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.392941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81c4d-3b66-41d4-a41c-0285a8594202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.393637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81c4d-3b66-41d4-a41c-0285a8594202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.393910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81c4d-3b66-41d4-a41c-0285a8594202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.394176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81c4d-3b66-41d4-a41c-0285a8594202 admin admin] PATH_INFO: `/v3/projects/09b8649c0c22454997a09becd8e9b1d1/users/97e2874025f140ab9167852b12b2ef32/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.406329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a03f41-03ec-48a7-982d-2a79c8c10622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.407056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a03f41-03ec-48a7-982d-2a79c8c10622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.407325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a03f41-03ec-48a7-982d-2a79c8c10622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.407615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a03f41-03ec-48a7-982d-2a79c8c10622 admin admin] PATH_INFO: `/v3/projects/9083fa37d6ec40c6bf2b551c5d7f8177/users/7998d31e0b6a4bf9be7b2c7e4005c547/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.410597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81c4d-3b66-41d4-a41c-0285a8594202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b8649c0c22454997a09becd8e9b1d1, user_id=97e2874025f140ab9167852b12b2ef32, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.413376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81c4d-3b66-41d4-a41c-0285a8594202 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.422439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a03f41-03ec-48a7-982d-2a79c8c10622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9083fa37d6ec40c6bf2b551c5d7f8177, user_id=7998d31e0b6a4bf9be7b2c7e4005c547, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.425124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a03f41-03ec-48a7-982d-2a79c8c10622 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.428235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 810/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:30 2022] PUT /identity/v3/projects/09b8649c0c22454997a09becd8e9b1d1/users/97e2874025f140ab9167852b12b2ef32/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:30.430746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.430746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.430746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.439006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 798/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:30 2022] PUT /identity/v3/projects/9083fa37d6ec40c6bf2b551c5d7f8177/users/7998d31e0b6a4bf9be7b2c7e4005c547/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:30.443958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.444239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.444506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.449335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.450521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.470762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] MFA Rules not processed for user `714fa7c7cbb04714ab3fa140d3279f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.471994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.515880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 811/1609] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.516832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.543472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 799/1610] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.544299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.554765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737920b9-0c7b-45a0-95c8-5283670abb3b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.559193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.559843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.560144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.560408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] PATH_INFO: `/v3/projects/f23d09c67d8d47fba9b6d09925dea02e/users/8256ead2715c4dd0809f856db9e9811b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.578972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23d09c67d8d47fba9b6d09925dea02e, user_id=8256ead2715c4dd0809f856db9e9811b, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.580053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb914b7-b95f-4eaf-8b3b-1dd74f8eb19e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.581769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.585407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.586225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.586529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.586791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.594081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:30.596790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 800/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:30 2022] PUT /identity/v3/projects/f23d09c67d8d47fba9b6d09925dea02e/users/8256ead2715c4dd0809f856db9e9811b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:30.599138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.601037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.601191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.611595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 812/1612] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:30.612494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.621981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc1b7a-9ec5-44d3-a251-cdc6f9b2aa0e service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.630778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:30.672566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155777f1-517d-4d46-9e30-10c8705a63fc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.678292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ccb55-4119-4c80-8bf5-7fc1466696be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.679054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ccb55-4119-4c80-8bf5-7fc1466696be admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.679430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ccb55-4119-4c80-8bf5-7fc1466696be admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.679798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ccb55-4119-4c80-8bf5-7fc1466696be admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.680537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ccb55-4119-4c80-8bf5-7fc1466696be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.682688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ccb55-4119-4c80-8bf5-7fc1466696be admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.688880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d849f-5f59-45e6-b5a8-9d5598c4cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.689360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d849f-5f59-45e6-b5a8-9d5598c4cdad admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.689695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d849f-5f59-45e6-b5a8-9d5598c4cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.689969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d849f-5f59-45e6-b5a8-9d5598c4cdad admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.691222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d849f-5f59-45e6-b5a8-9d5598c4cdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.693075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d849f-5f59-45e6-b5a8-9d5598c4cdad admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.705874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 813/1613] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:30.707342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.707638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.708020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.712666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 801/1614] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:30.712666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1f4b-35ac-41d9-8a28-43284173a673 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.712666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1f4b-35ac-41d9-8a28-43284173a673 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.712666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1f4b-35ac-41d9-8a28-43284173a673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.731253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.732558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.733005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c62e1f4b-35ac-41d9-8a28-43284173a673 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.734173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c62e1f4b-35ac-41d9-8a28-43284173a673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.741291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 814/1615] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.742104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.742319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 802/1616] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.743624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66ffc8-69c5-4dff-81fe-9e66667ec0c2 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.743904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66ffc8-69c5-4dff-81fe-9e66667ec0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.744272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66ffc8-69c5-4dff-81fe-9e66667ec0c2 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.745989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 803/1617] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 10 11:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:30.751854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.752133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.752395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.772179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.773418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.781845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 804/1618] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.782776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.796780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d590d-5a94-415f-a666-9c3120a6e782 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.803730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.804433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.804861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.805480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] PATH_INFO: `/v3/projects/07d7d64e6016430f97bb0f8256f7834b/users/9c03839df7704fbfa3c913623e2bef8b/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.820072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bad63-a978-47e7-81c6-f7c2617031ee None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.823221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d7d64e6016430f97bb0f8256f7834b, user_id=9c03839df7704fbfa3c913623e2bef8b, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.823946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fcbba-e4ef-4b80-b0bf-b9e446e1f41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.824565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcbba-e4ef-4b80-b0bf-b9e446e1f41b service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.824836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcbba-e4ef-4b80-b0bf-b9e446e1f41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.825129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcbba-e4ef-4b80-b0bf-b9e446e1f41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.826020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.835375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcbba-e4ef-4b80-b0bf-b9e446e1f41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.836828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcbba-e4ef-4b80-b0bf-b9e446e1f41b service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.841428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 805/1619] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:30 2022] PUT /identity/v3/projects/07d7d64e6016430f97bb0f8256f7834b/users/9c03839df7704fbfa3c913623e2bef8b/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:30.845147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.847873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 815/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:30.849646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.850182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.850471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.897515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:30.898772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.918060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3349-744d-4069-a89b-617e487a0d78 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:30.923161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:30.924155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:30.924657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:30.924932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:30.925747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:30.928008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:30.939523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 806/1621] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:30.940568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.943443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.982645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 816/1622] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 10 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:30.983686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:30.985097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:30.992215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:31.023983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46478e92-e576-4cff-abaf-2cb8fe06c1bd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.029912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.030537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.030807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.031072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.046464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.049106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.065868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 807/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:31.067879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.081456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f7f64-1143-4ed7-b0c9-14a512dbc6b0 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.085263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b5038-ff4e-4f8e-9d44-8dbf37d93d20 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.086379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.087051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.087324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.087589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.092347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.093532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.093990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.094306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.100942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.103236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.123285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.124911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.127234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 808/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:31.128681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.135539 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:31.143374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561752a-d8e0-4b1e-b224-619477a41812 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.149537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.150271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.150715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.151159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.151725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 817/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:31.152627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.152734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.155554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.165597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecabd1e-354b-4120-b9eb-4d8f5fa4bbb4 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.172009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.172744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 809/1626] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:31.173723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.176594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.176941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.177388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] PATH_INFO: `/v3/projects/3d9694c7e8614336a64a52b34739ced0/users/78b9fc184c6a4e24bb81e31fd7949b28/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.193091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13ad95-4f66-42dd-b9b6-5e4d67ddc20b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.197228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9694c7e8614336a64a52b34739ced0, user_id=78b9fc184c6a4e24bb81e31fd7949b28, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.199725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.200383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.200498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.200654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.200917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.219321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 818/1627] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:31 2022] PUT /identity/v3/projects/3d9694c7e8614336a64a52b34739ced0/users/78b9fc184c6a4e24bb81e31fd7949b28/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:31.219321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.281322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.283830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.296066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacc427-b077-45e1-88ee-af78ca839ad3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.297656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 810/1628] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:31.298377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.311885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b382-0f4e-49af-8377-49669081e624 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.318413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.319073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.319356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.319624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.319800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a77b69-bdd2-480e-9499-6dc0a5d6852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.320465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a77b69-bdd2-480e-9499-6dc0a5d6852a admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.320574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.320756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a77b69-bdd2-480e-9499-6dc0a5d6852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.321008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a77b69-bdd2-480e-9499-6dc0a5d6852a admin admin] PATH_INFO: `/v3/projects/07d7d64e6016430f97bb0f8256f7834b/users/9c03839df7704fbfa3c913623e2bef8b/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.322645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.327691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a77b69-bdd2-480e-9499-6dc0a5d6852a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d7d64e6016430f97bb0f8256f7834b, user_id=9c03839df7704fbfa3c913623e2bef8b, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.330413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a77b69-bdd2-480e-9499-6dc0a5d6852a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.335509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 811/1629] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:31.339423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.361656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 819/1630] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:31 2022] PUT /identity/v3/projects/07d7d64e6016430f97bb0f8256f7834b/users/9c03839df7704fbfa3c913623e2bef8b/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:31.363420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.363703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.363969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.381735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce1dcc-ad44-44d8-a015-311dcfcc01a6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.405721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] MFA Rules not processed for user `9c03839df7704fbfa3c913623e2bef8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:31.408453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:31.499676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41aa5ca-dac0-413c-a5d3-812b56d8e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.501519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa5ca-dac0-413c-a5d3-812b56d8e9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.501807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa5ca-dac0-413c-a5d3-812b56d8e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.502937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa5ca-dac0-413c-a5d3-812b56d8e9e0 admin admin] PATH_INFO: `/v3/projects/3d9694c7e8614336a64a52b34739ced0/users/78b9fc184c6a4e24bb81e31fd7949b28/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.510523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41aa5ca-dac0-413c-a5d3-812b56d8e9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9694c7e8614336a64a52b34739ced0, user_id=78b9fc184c6a4e24bb81e31fd7949b28, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.519597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41aa5ca-dac0-413c-a5d3-812b56d8e9e0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.548921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 820/1631] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:31.550519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.550653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 812/1632] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:31 2022] PUT /identity/v3/projects/3d9694c7e8614336a64a52b34739ced0/users/78b9fc184c6a4e24bb81e31fd7949b28/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:31.560553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19b66-5fef-4551-8882-6e15a777f38c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.560836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19b66-5fef-4551-8882-6e15a777f38c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.561168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19b66-5fef-4551-8882-6e15a777f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.562759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:31.606196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b0d19b66-5fef-4551-8882-6e15a777f38c None None] MFA Rules not processed for user `78b9fc184c6a4e24bb81e31fd7949b28`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:31.607467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b0d19b66-5fef-4551-8882-6e15a777f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:31.671560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f68e-40c2-4445-9268-a66b8a3916f8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.743447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:31.749815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.751466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.751952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.753412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.761853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 813/1633] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:31.766665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc1dbe-dd5c-41fc-9a8d-8bc2593d49e6 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.766950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc1dbe-dd5c-41fc-9a8d-8bc2593d49e6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.767530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc1dbe-dd5c-41fc-9a8d-8bc2593d49e6 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.769225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 814/1634] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 10 11:10:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:31.771432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc1dbe-dd5c-41fc-9a8d-8bc2593d49e6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:31.789834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc1dbe-dd5c-41fc-9a8d-8bc2593d49e6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:31.796165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad111-9493-4285-be4d-701da2707415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:31.798010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad111-9493-4285-be4d-701da2707415 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.799185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad111-9493-4285-be4d-701da2707415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.800284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad111-9493-4285-be4d-701da2707415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.816384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad111-9493-4285-be4d-701da2707415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.818890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad111-9493-4285-be4d-701da2707415 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.836564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 815/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:31.852849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:31.853340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:31.853617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:31.891758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:31.893588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:31.898643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:31.899964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:31.926132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 821/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:32.099922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 816/1637] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:32.143963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:32.159088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5556d-1b64-4e8b-ae27-3c9a87f7e019 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:32.168556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:32.169602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:32.171444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:32.178204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:32.180073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:32.183394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded893e-ac64-4782-a1f4-5ea10f4c4b81 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:32.190174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb800e-16e4-4c62-b2af-f07919ffacfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:32.192540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb800e-16e4-4c62-b2af-f07919ffacfa service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:32.193056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb800e-16e4-4c62-b2af-f07919ffacfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:32.193674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb800e-16e4-4c62-b2af-f07919ffacfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:32.211723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:32.216682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:32.241931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 822/1638] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:32.364778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb800e-16e4-4c62-b2af-f07919ffacfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:32.366839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb800e-16e4-4c62-b2af-f07919ffacfa service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:32.400644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 817/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:10:33.382630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:33.505661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:33.514465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2015373-e8e7-4bdc-ab59-e9885e9772c2 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:33.523379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:33.524379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:33.524718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:33.525373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] PATH_INFO: `/v3/users/8444840f533b49049766f90d86c28d97` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:33.526722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8444840f533b49049766f90d86c28d97)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:33.528038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:33.528038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: warnings.warn(msg) Aug 10 11:10:33.528038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: Aug 10 11:10:33.529956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:33.681322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8444840f533b49049766f90d86c28d97'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:33.702928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8444840f533b49049766f90d86c28d97'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:33.737673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8444840f533b49049766f90d86c28d97'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:33.739242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8444840f533b49049766f90d86c28d97'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:33.742611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-59eaf67f-d49f-456a-86f6-420837732143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8444840f533b49049766f90d86c28d97'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:33.778559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 823/1640] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:10:33 2022] DELETE /identity/v3/users/8444840f533b49049766f90d86c28d97 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:33.782923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9382-4f30-4e40-9afb-b96ef1315b00 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:33.783382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9382-4f30-4e40-9afb-b96ef1315b00 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:33.783704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9382-4f30-4e40-9afb-b96ef1315b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:33.807167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9d7e9382-4f30-4e40-9afb-b96ef1315b00 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:33.810281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9d7e9382-4f30-4e40-9afb-b96ef1315b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:33.816486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239480e8-e50a-49d7-841b-174c76503a7a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:33.817032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239480e8-e50a-49d7-841b-174c76503a7a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:33.817229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239480e8-e50a-49d7-841b-174c76503a7a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:33.819089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 824/1641] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 10 11:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:33.827021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03195ea3-1e5b-471d-bce8-83bb50547f62 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:33.827570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03195ea3-1e5b-471d-bce8-83bb50547f62 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:33.827849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03195ea3-1e5b-471d-bce8-83bb50547f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:33.862023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-03195ea3-1e5b-471d-bce8-83bb50547f62 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:33.863318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-03195ea3-1e5b-471d-bce8-83bb50547f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:33.901039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 818/1642] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:33.982866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 825/1643] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 10 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:33.989364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fca32f-f924-48c0-8444-8c9f3108e228 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:33.989956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fca32f-f924-48c0-8444-8c9f3108e228 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:33.990418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fca32f-f924-48c0-8444-8c9f3108e228 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:33.992688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 819/1644] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 10 11:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:33.998061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:33.998493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:33.998762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:34.007216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fca32f-f924-48c0-8444-8c9f3108e228 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:34.009790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c6fca32f-f924-48c0-8444-8c9f3108e228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:34.046488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:34.047724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:34.053956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:34.079005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 826/1645] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:34.093986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:34.095790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:34.138462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fca32f-f924-48c0-8444-8c9f3108e228 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:34.142696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:34.143702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:34.144393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:34.144673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:34.156477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:34.157995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:34.169391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 820/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:34.209582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef81f9-d6e5-4f99-a8e9-bad2b18ca842 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:34.216142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:34.216967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:34.217329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:34.217738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:34.233642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:34.237996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:34.273942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 827/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:10:38.053529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:38.055848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:38.084397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a271bb-d7fd-472f-b964-f560e851cd4b service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:38.133735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:38.134805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:38.136584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:38.137839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] PATH_INFO: `/v3/projects/bbf759ed74a34385960c4020e7b67253` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:38.144005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf759ed74a34385960c4020e7b67253)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:38.159873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: WARNING py.warnings [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:38.159873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: warnings.warn(msg) Aug 10 11:10:38.159873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: Aug 10 11:10:38.164276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:38.327951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf759ed74a34385960c4020e7b67253', 'request_id': 'req-7307e406-ec9a-46d6-8a88-96f16db5532d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.355096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf759ed74a34385960c4020e7b67253', 'request_id': 'req-7307e406-ec9a-46d6-8a88-96f16db5532d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.362642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:38.365066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:38.378729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:38.389556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4b73-2459-41cd-9b61-7609a510def9 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:38.390081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf759ed74a34385960c4020e7b67253', 'request_id': 'req-7307e406-ec9a-46d6-8a88-96f16db5532d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.422578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] The token cache is being invalidate because project bbf759ed74a34385960c4020e7b67253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:10:38.422578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.433497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.435947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 821/1648] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:10:38 2022] DELETE /identity/v3/projects/bbf759ed74a34385960c4020e7b67253 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:38.440968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:38.442762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:38.569428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:38.570875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:38.571171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:38.575489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] PATH_INFO: `/v3/users/714fa7c7cbb04714ab3fa140d3279f30` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:38.575825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307e406-ec9a-46d6-8a88-96f16db5532d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:38.576878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714fa7c7cbb04714ab3fa140d3279f30)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:38.579008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:38.590179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:38.590849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:38.591134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:38.591879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] PATH_INFO: `/v3/users/78b9fc184c6a4e24bb81e31fd7949b28` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:38.592678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b9fc184c6a4e24bb81e31fd7949b28)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:38.596013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:38.673326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714fa7c7cbb04714ab3fa140d3279f30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.685576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714fa7c7cbb04714ab3fa140d3279f30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.691576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:38.704459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b9fc184c6a4e24bb81e31fd7949b28'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.711305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714fa7c7cbb04714ab3fa140d3279f30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.712596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714fa7c7cbb04714ab3fa140d3279f30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.714494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-03411a6b-6767-46ac-b04e-5fda73399ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714fa7c7cbb04714ab3fa140d3279f30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.733619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b9fc184c6a4e24bb81e31fd7949b28'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.734217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 828/1649] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:10:38 2022] DELETE /identity/v3/users/714fa7c7cbb04714ab3fa140d3279f30 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:10:38.736266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:38.736686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:38.737318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:38.748286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b9fc184c6a4e24bb81e31fd7949b28'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.751687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b9fc184c6a4e24bb81e31fd7949b28'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.752378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b9fc184c6a4e24bb81e31fd7949b28'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:38.778519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 822/1650] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:10:38 2022] DELETE /identity/v3/users/78b9fc184c6a4e24bb81e31fd7949b28 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:10:38.780240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:38.783764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:38.934016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 829/1651] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:38.974501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:38.975998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:39.129388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a13f9-e927-4fe1-baa4-27fda6390e2b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:39.155704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaae37e-fb0a-438d-8ee8-7f44de39481e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:39.156612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae37e-fb0a-438d-8ee8-7f44de39481e service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:39.157089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae37e-fb0a-438d-8ee8-7f44de39481e service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:39.157495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae37e-fb0a-438d-8ee8-7f44de39481e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:39.190336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaae37e-fb0a-438d-8ee8-7f44de39481e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:39.192082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaae37e-fb0a-438d-8ee8-7f44de39481e service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:39.221192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 823/1652] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:40.672785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:40.674335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:40.717521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc541a5d-5cb0-437f-9801-1ad30236d85b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:40.743149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:40.747612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:40.748140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:40.748413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] PATH_INFO: `/v3/projects/23dec40c4f48493095c4ce6ed13270f4` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:40.749882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dec40c4f48493095c4ce6ed13270f4)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:40.752036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:40.800446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:40.856209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dec40c4f48493095c4ce6ed13270f4', 'request_id': 'req-6c3cc864-9b74-4c54-aadd-c8437de81ce5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:40.871163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dec40c4f48493095c4ce6ed13270f4', 'request_id': 'req-6c3cc864-9b74-4c54-aadd-c8437de81ce5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:40.880687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dec40c4f48493095c4ce6ed13270f4', 'request_id': 'req-6c3cc864-9b74-4c54-aadd-c8437de81ce5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:40.895733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] The token cache is being invalidate because project 23dec40c4f48493095c4ce6ed13270f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:10:40.896008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:40.897510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6c3cc864-9b74-4c54-aadd-c8437de81ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:40.899864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 830/1653] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:10:40 2022] DELETE /identity/v3/projects/23dec40c4f48493095c4ce6ed13270f4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:40.907160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:40.908075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:40.908524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:40.951112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:40.958682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:41.129441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 824/1654] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:41.142907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.144114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.147651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.209997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:41.213562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:41.224770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 831/1655] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:41.230238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.246115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4809-e2b4-49ca-b062-d7aa03cb9003 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.249300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.251173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:41.265819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:41.266415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.266618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.266887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.267557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:41.267858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:41.269723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:41.298855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1bf5e-d225-4af1-8753-523a9b500226 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.314746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 825/1656] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:41.319679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.321731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:41.322308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.322700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.323004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] PATH_INFO: `/v3/projects/3d9694c7e8614336a64a52b34739ced0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.324812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9694c7e8614336a64a52b34739ced0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:41.328180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:41.348547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cdc8e-4ad4-4392-91e5-8ae9508ea43b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.359286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:41.360017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.360369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.360706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.361441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:41.364939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:41.444776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 826/1657] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:41 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:41.447409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.462692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9694c7e8614336a64a52b34739ced0', 'request_id': 'req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:41.472611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9694c7e8614336a64a52b34739ced0', 'request_id': 'req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:41.497010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9694c7e8614336a64a52b34739ced0', 'request_id': 'req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:41.512621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] The token cache is being invalidate because project 3d9694c7e8614336a64a52b34739ced0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:10:41.512929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:41.513606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aa42f5be-b5dc-44b5-81cb-daf05b2e7322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:41.516330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:41.517888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 832/1658] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:10:41 2022] DELETE /identity/v3/projects/3d9694c7e8614336a64a52b34739ced0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:41.526590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6416e-62b4-4655-99c9-16d1497d17e4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.526875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6416e-62b4-4655-99c9-16d1497d17e4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.527160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6416e-62b4-4655-99c9-16d1497d17e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.605210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a9b6416e-62b4-4655-99c9-16d1497d17e4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:41.606612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a9b6416e-62b4-4655-99c9-16d1497d17e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:41.744887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0cef1-72ae-4e1a-817f-b8db1e7483cc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.797666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 833/1659] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:41.807008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.807008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.807008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.850309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:41.851476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:41.873319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 834/1660] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:41.882085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.895414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:41.896061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.896339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.896731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.897906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29146-45e6-4a1d-a759-d966b1eed217 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.898009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:41.900835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:41.908136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:41.908136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:41.908136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:41.908479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:41.908902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:41.909274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:41.911300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:41.948181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 827/1661] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:41 2022] POST /identity/v3/users => generated 279 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:10:41.952047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.953286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 835/1662] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:41.957296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:41.958256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:41.965764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:41.975356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695e885-510d-41de-8d01-29f61d0e4b23 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.983143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06d87-510c-49fc-a9ae-37d9db4a5dcc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:41.999336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.001219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.001697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.003094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.004916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.005243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.005561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.005837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.006106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.006741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.008723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.028426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.031189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 828/1663] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:10:42.035037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.094741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f7d86-3695-45b4-a17c-875398c23d7c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.095856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 836/1664] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:41 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:42.101807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.234838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0000ab-bf06-44ee-ba63-8cc9f0b95b3a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.244017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.245032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.245318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.245590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.246232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.248219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.302944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 837/1665] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:42 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:42.307895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.309386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.310218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.310520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.311048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.311860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.317697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.336352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 829/1666] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:42.340380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.353614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a426a-74e2-4be4-9329-50fafc9d9589 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.360097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a433-c304-40f3-a5b4-b10a77e46a30 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.365816 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.366463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.366739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.367007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.367667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.368773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d48dd-0b94-4778-aa1d-4e0f00376a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.370300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d48dd-0b94-4778-aa1d-4e0f00376a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.370739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d48dd-0b94-4778-aa1d-4e0f00376a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.371139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d48dd-0b94-4778-aa1d-4e0f00376a67 admin admin] PATH_INFO: `/v3/projects/17ca1d8dd6ec44a7b2ea51af0f7416e0/users/a4ad9ff4aebb49c790c843af14977229/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.373815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.393625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d48dd-0b94-4778-aa1d-4e0f00376a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ca1d8dd6ec44a7b2ea51af0f7416e0, user_id=a4ad9ff4aebb49c790c843af14977229, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.397841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d48dd-0b94-4778-aa1d-4e0f00376a67 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.399813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 838/1667] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:42.402854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.425718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 830/1668] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:42 2022] PUT /identity/v3/projects/17ca1d8dd6ec44a7b2ea51af0f7416e0/users/a4ad9ff4aebb49c790c843af14977229/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:10:42.438005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a688-b181-488d-9192-fef1025d0250 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.440545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a688-b181-488d-9192-fef1025d0250 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.441447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a688-b181-488d-9192-fef1025d0250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.447952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beaaa-32fb-45f9-adfc-d3982f624697 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.485665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3502a688-b181-488d-9192-fef1025d0250 None None] MFA Rules not processed for user `a4ad9ff4aebb49c790c843af14977229`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:42.487535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3502a688-b181-488d-9192-fef1025d0250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:42.537446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:42.621525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.622200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.622505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.622781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.627987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.629764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.640252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 831/1669] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:42.645275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a688-b181-488d-9192-fef1025d0250 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.646614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 839/1670] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:42.650699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.668458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f1c02-13ee-4a77-965f-698d50fc45be admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.672117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a688-b181-488d-9192-fef1025d0250 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.678797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56e02c-1386-4f7f-95f6-2d8bc9722dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.679473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e02c-1386-4f7f-95f6-2d8bc9722dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.680546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e02c-1386-4f7f-95f6-2d8bc9722dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.681304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.682095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.682505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.682936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e02c-1386-4f7f-95f6-2d8bc9722dca admin admin] PATH_INFO: `/v3/projects/2a0ed213827a4f99a86c003fcb23e26a/users/446f46645f7d4fe3bc3c763924b63994/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.683339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.684948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.687035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.714776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e02c-1386-4f7f-95f6-2d8bc9722dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0ed213827a4f99a86c003fcb23e26a, user_id=446f46645f7d4fe3bc3c763924b63994, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.719446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e02c-1386-4f7f-95f6-2d8bc9722dca admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:42.763016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 832/1671] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:42 2022] POST /identity/v3/projects => generated 353 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:42.766809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 840/1672] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:42 2022] PUT /identity/v3/projects/2a0ed213827a4f99a86c003fcb23e26a/users/446f46645f7d4fe3bc3c763924b63994/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:42.777523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:42.779101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.779562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.780012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.879644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] MFA Rules not processed for user `446f46645f7d4fe3bc3c763924b63994`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:42.880876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:42.925493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:42.949239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0b1d-81a1-439a-bb21-0cd98963012e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:42.958951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:42.959802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:42.960210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:42.968690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:42.971534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:42.975515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.045283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 833/1673] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:42 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:10:43.046283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.061884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450a926-92f3-4a61-957a-a07e9f792d31 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.084658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.089046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.089046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.089476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.091914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.112519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.116826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 841/1674] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:43.118145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.139882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 834/1675] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:43.144436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.180708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e60bc-6d24-42fa-9fd3-f0516d05fd56 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.187129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af07e5-1e78-4cbf-853a-8aac7abf74b7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.199378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786df6-51de-4562-8ddd-9692b14857c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.200248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786df6-51de-4562-8ddd-9692b14857c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.213253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.213894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.214166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.214264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786df6-51de-4562-8ddd-9692b14857c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.214420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.214507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786df6-51de-4562-8ddd-9692b14857c1 admin admin] PATH_INFO: `/v3/projects/ddb2294fc4034d7695e8a0bf48d0da7e/users/efaf79e374bc49d7b7e15f6767d0ba19/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.220759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.231013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.246790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786df6-51de-4562-8ddd-9692b14857c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb2294fc4034d7695e8a0bf48d0da7e, user_id=efaf79e374bc49d7b7e15f6767d0ba19, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.249533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786df6-51de-4562-8ddd-9692b14857c1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.283335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 835/1676] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:43 2022] PUT /identity/v3/projects/ddb2294fc4034d7695e8a0bf48d0da7e/users/efaf79e374bc49d7b7e15f6767d0ba19/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:43.285250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.285532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.285797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.321896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] MFA Rules not processed for user `8256ead2715c4dd0809f856db9e9811b`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:43.322645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:43.361350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 842/1677] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:43 2022] POST /identity/v3/projects => generated 393 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:43.366740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.374864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:43.416725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 836/1678] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:43.427274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.538127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001573a-53bb-4ec4-bec3-a532bd89829d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.575970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301aa21-325d-4ec3-8fc6-b12f4e9419c5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.589976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.590727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.591044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.591314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.592210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.594385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.620611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 843/1679] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:43.625910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.632582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:43.640869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.641887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.642462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.642919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.643808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.646514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.681445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 837/1680] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:43 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:43.683222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.711610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8848801-c1d7-4f3a-922e-fad013cc7162 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.724708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.727040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.727614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.728206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] PATH_INFO: `/v3/projects/ddb2294fc4034d7695e8a0bf48d0da7e/users/efaf79e374bc49d7b7e15f6767d0ba19/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.733518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb2294fc4034d7695e8a0bf48d0da7e, user_id=efaf79e374bc49d7b7e15f6767d0ba19, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.738815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.742795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0742aef-7d46-4182-b916-18ca2f87174d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.749133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818db9-56db-4bef-bd69-c787332ced44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.749756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818db9-56db-4bef-bd69-c787332ced44 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.750127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818db9-56db-4bef-bd69-c787332ced44 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.750456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818db9-56db-4bef-bd69-c787332ced44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.779717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 838/1681] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:43 2022] PUT /identity/v3/projects/ddb2294fc4034d7695e8a0bf48d0da7e/users/efaf79e374bc49d7b7e15f6767d0ba19/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:43.783537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:43.784431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:43.820961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818db9-56db-4bef-bd69-c787332ced44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.822767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818db9-56db-4bef-bd69-c787332ced44 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.834287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 844/1682] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:43.835777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.836151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.836516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.867457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] MFA Rules not processed for user `efaf79e374bc49d7b7e15f6767d0ba19`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:43.868827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:43.928393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88131-dba1-48ee-a236-07701ae99811 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:43.939105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:43.941506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:43.941791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:43.942058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:43.945202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:43.949151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:43.957127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:43.983981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 845/1683] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:43.998400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 839/1684] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:44.001701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:44.001958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:44.004401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:44.027821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1dafd-5a37-45b6-b38c-68c38d40da80 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:44.034741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:44.035429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.035702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.035967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] PATH_INFO: `/v3/projects/d5d13727013b4277804cd3afaff9a733/users/e3a90f3666304485a206b8dab1a3196d/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.075842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d13727013b4277804cd3afaff9a733, user_id=e3a90f3666304485a206b8dab1a3196d, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:44.078632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:44.108137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 846/1685] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:44 2022] PUT /identity/v3/projects/d5d13727013b4277804cd3afaff9a733/users/e3a90f3666304485a206b8dab1a3196d/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:44.110416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:44.120038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc80b4-1d1e-4acb-a249-50784092ef67 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:44.247867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bbfb0-2c3c-4d11-9a61-ceacd886ad9c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:44.260244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:44.260927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.261224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.261488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.264570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:44.265736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:44.266523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.266848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.267149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:44.267260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.299674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 847/1686] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:10:44.304502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:44.330722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461b5a7-6d60-46a6-8c20-434884a43ac6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:44.340996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26d62-377e-4fe6-ab7a-e3b31e9fff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:44.341826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26d62-377e-4fe6-ab7a-e3b31e9fff5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.342101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26d62-377e-4fe6-ab7a-e3b31e9fff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.342377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26d62-377e-4fe6-ab7a-e3b31e9fff5b admin admin] PATH_INFO: `/v3/projects/d5d13727013b4277804cd3afaff9a733/users/e3a90f3666304485a206b8dab1a3196d/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.348125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26d62-377e-4fe6-ab7a-e3b31e9fff5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d13727013b4277804cd3afaff9a733, user_id=e3a90f3666304485a206b8dab1a3196d, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:44.350989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26d62-377e-4fe6-ab7a-e3b31e9fff5b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:44.401867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 848/1687] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:44 2022] PUT /identity/v3/projects/d5d13727013b4277804cd3afaff9a733/users/e3a90f3666304485a206b8dab1a3196d/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:44.412655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.412936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.413235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.453056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:44.454824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:44.484315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 840/1688] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:44.491743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] MFA Rules not processed for user `e3a90f3666304485a206b8dab1a3196d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:44.497282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:44.511744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:44.683314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:44.693710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 849/1689] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:44.701150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aa3e2-92f9-4734-9f9c-8fbf24e11881 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:44.862111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c5a7e-dbb6-4f3c-8b05-5d446317cfbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:44.865317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c5a7e-dbb6-4f3c-8b05-5d446317cfbb service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.865697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c5a7e-dbb6-4f3c-8b05-5d446317cfbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.865965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c5a7e-dbb6-4f3c-8b05-5d446317cfbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.871775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:44.874276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:44.894898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20bba9-8001-4ae6-984b-68dc3392be3c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:44.911334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:44.911849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:44.912562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:44.912962 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:44.913347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:44.932356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:44.933940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:44.959116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 850/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:10:45.030280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c5a7e-dbb6-4f3c-8b05-5d446317cfbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:45.031954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c5a7e-dbb6-4f3c-8b05-5d446317cfbb service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:45.074282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 841/1691] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:45.165239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:45.176323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12402-989b-4eef-90b1-3823d40c2aae service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:45.196256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:45.196878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:45.197189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:45.197457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:45.333558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:45.335086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:45.354548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 851/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:47.222969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c20387-8afa-4ae3-83ae-b78cedfef45f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:47.223902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c20387-8afa-4ae3-83ae-b78cedfef45f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:47.224336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c20387-8afa-4ae3-83ae-b78cedfef45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:47.324544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-31c20387-8afa-4ae3-83ae-b78cedfef45f None None] MFA Rules not processed for user `d01d3fdea0f9451e8301003c34734569`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:47.325847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-31c20387-8afa-4ae3-83ae-b78cedfef45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:47.609423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 842/1693] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:47.630064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:47.634530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:47.921105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f255-0ddd-4dbb-b4cd-f59e87dd1a4e service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:47.944239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:47.944882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:47.945193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:47.949153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:48.006822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:48.008514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:48.031327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf28e2-db55-4d48-bdd0-3437024461c8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:48.031716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf28e2-db55-4d48-bdd0-3437024461c8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:48.032000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf28e2-db55-4d48-bdd0-3437024461c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:48.061259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 852/1694] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:48.152576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6cbf28e2-db55-4d48-bdd0-3437024461c8 None None] MFA Rules not processed for user `95398f8ac1ca42c0969b37f54a582e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:48.157976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6cbf28e2-db55-4d48-bdd0-3437024461c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:48.500160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 843/1695] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:48.509201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:48.537618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded286-cc60-4752-bb28-166c298b847f service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:48.577379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73f4a-31db-4536-9acd-17874c33ac15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:48.580743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73f4a-31db-4536-9acd-17874c33ac15 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:48.581297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73f4a-31db-4536-9acd-17874c33ac15 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:48.581711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73f4a-31db-4536-9acd-17874c33ac15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:48.632937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b73f4a-31db-4536-9acd-17874c33ac15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:48.647175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b73f4a-31db-4536-9acd-17874c33ac15 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:48.665406 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:48.704175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 853/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:49.333761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:49.334043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:49.334309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:49.412409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] MFA Rules not processed for user `7998d31e0b6a4bf9be7b2c7e4005c547`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:49.413686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:49.528299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:49.663784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 844/1697] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:49.674355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d151-38ca-4741-ad50-aa85859cdc6f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:49.674931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d151-38ca-4741-ad50-aa85859cdc6f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:49.675007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d151-38ca-4741-ad50-aa85859cdc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:49.713547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7fe3d151-38ca-4741-ad50-aa85859cdc6f None None] MFA Rules not processed for user `7998d31e0b6a4bf9be7b2c7e4005c547`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:49.717378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7fe3d151-38ca-4741-ad50-aa85859cdc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:49.740506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 854/1698] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:49.761724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:49.786888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf537b-4806-4544-9f91-776652d1bb7e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:49.804395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db411a66-ee08-461d-ab72-bff44269fa90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:49.805385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411a66-ee08-461d-ab72-bff44269fa90 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:49.805992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411a66-ee08-461d-ab72-bff44269fa90 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:49.806921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411a66-ee08-461d-ab72-bff44269fa90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:49.827385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db411a66-ee08-461d-ab72-bff44269fa90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:49.831940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db411a66-ee08-461d-ab72-bff44269fa90 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:49.862159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 845/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:50.669880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be71b4-ed0e-43be-a444-ff5c9186bb86 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:50.670143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be71b4-ed0e-43be-a444-ff5c9186bb86 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:50.670412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be71b4-ed0e-43be-a444-ff5c9186bb86 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:50.671788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 855/1700] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 10 11:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:50.683548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:50.688167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:50.688690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:50.761168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:50.768832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:50.943784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 846/1701] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:51.057136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be71b4-ed0e-43be-a444-ff5c9186bb86 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:51.059280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-74be71b4-ed0e-43be-a444-ff5c9186bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:51.083504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be71b4-ed0e-43be-a444-ff5c9186bb86 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:51.092117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c59bd4-3e92-4fec-be20-fcfe563dc55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:51.093137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c59bd4-3e92-4fec-be20-fcfe563dc55d service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:51.093614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c59bd4-3e92-4fec-be20-fcfe563dc55d service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:51.094688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c59bd4-3e92-4fec-be20-fcfe563dc55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:51.112460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c59bd4-3e92-4fec-be20-fcfe563dc55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:51.132949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c59bd4-3e92-4fec-be20-fcfe563dc55d service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:51.149979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 856/1702] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:51.378605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:51.555482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ec97-e5f2-4375-bd0c-fb4674f16b86 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:51.578032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40660cc-f751-4b3c-b5b5-c23aad2aea5f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:51.578384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40660cc-f751-4b3c-b5b5-c23aad2aea5f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:51.578667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40660cc-f751-4b3c-b5b5-c23aad2aea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:51.584689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:51.585775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:51.586263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:51.586700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] PATH_INFO: `/v3/users/446f46645f7d4fe3bc3c763924b63994` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:51.589646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446f46645f7d4fe3bc3c763924b63994)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:51.592076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:51.641693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f40660cc-f751-4b3c-b5b5-c23aad2aea5f None None] MFA Rules not processed for user `97e2874025f140ab9167852b12b2ef32`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:51.643956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f40660cc-f751-4b3c-b5b5-c23aad2aea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:51.703240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446f46645f7d4fe3bc3c763924b63994'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:51.721936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:51.739937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446f46645f7d4fe3bc3c763924b63994'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:51.754945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446f46645f7d4fe3bc3c763924b63994'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:51.756262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446f46645f7d4fe3bc3c763924b63994'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:51.757141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3328f347-90bb-44b9-a4d9-fd6c87eaecf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446f46645f7d4fe3bc3c763924b63994'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:51.781592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 847/1703] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:10:51 2022] DELETE /identity/v3/users/446f46645f7d4fe3bc3c763924b63994 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:51.787804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:51.788284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:51.788735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:51.797837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 857/1704] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:51.809173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:51.809945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:51.810354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:51.832055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:51.834867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:51.855012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] MFA Rules not processed for user `97e2874025f140ab9167852b12b2ef32`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:51.856818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:51.958089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 858/1705] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:51.964136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:51.967416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:51.986503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 848/1706] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:52.000110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:52.002129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:52.165735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee26cb-0678-413d-8706-96cfe9f7c9a8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:52.193819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799402-e5a1-48eb-b2a8-e2ef467cf714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:52.194810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799402-e5a1-48eb-b2a8-e2ef467cf714 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.195227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799402-e5a1-48eb-b2a8-e2ef467cf714 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.195742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799402-e5a1-48eb-b2a8-e2ef467cf714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.210515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799402-e5a1-48eb-b2a8-e2ef467cf714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:52.221297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799402-e5a1-48eb-b2a8-e2ef467cf714 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:52.225788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:52.234091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 859/1707] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:10:52.234627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c2f7-795e-4072-972f-10eb26e286bb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:52.235932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35010397-a61e-44d3-8298-b85f83c6a11e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.236420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35010397-a61e-44d3-8298-b85f83c6a11e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.236893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35010397-a61e-44d3-8298-b85f83c6a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.241068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c31f-396a-415d-8f47-85d86acebe3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:52.241954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c31f-396a-415d-8f47-85d86acebe3d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.242228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c31f-396a-415d-8f47-85d86acebe3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.242494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c31f-396a-415d-8f47-85d86acebe3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.256063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c31f-396a-415d-8f47-85d86acebe3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:52.257757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c31f-396a-415d-8f47-85d86acebe3d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:52.259835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-35010397-a61e-44d3-8298-b85f83c6a11e None None] MFA Rules not processed for user `8256ead2715c4dd0809f856db9e9811b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:52.261275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-35010397-a61e-44d3-8298-b85f83c6a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:52.273400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 849/1708] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:52.275361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b76d12-e8cf-4a10-96ed-641e7cf4b909 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.275642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b76d12-e8cf-4a10-96ed-641e7cf4b909 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.276271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b76d12-e8cf-4a10-96ed-641e7cf4b909 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.278104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 850/1709] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 10 11:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:52.285608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f6b69-36ee-476d-955a-5d77c76c9f73 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.285848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f6b69-36ee-476d-955a-5d77c76c9f73 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.286110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f6b69-36ee-476d-955a-5d77c76c9f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.335274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fc2f6b69-36ee-476d-955a-5d77c76c9f73 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:52.336798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fc2f6b69-36ee-476d-955a-5d77c76c9f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:52.353994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 860/1710] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:52.361479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.361901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.362319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.390909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] MFA Rules not processed for user `7998d31e0b6a4bf9be7b2c7e4005c547`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:52.392279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:52.525518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 861/1711] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:52.545688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:52.558040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 851/1712] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 10 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:52.573793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32528e-0aff-4ade-940a-deacebeb9186 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:52.596390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:52.598971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:52.599659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:52.600219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:52.604964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:52.655186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:52.656934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797bd55-758f-43e7-a401-d2b6eb07f648 service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:52.698266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 862/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:10:53.261145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400110-f0c7-43de-acfd-fe237e0f1763 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:53.261660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400110-f0c7-43de-acfd-fe237e0f1763 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:53.261660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400110-f0c7-43de-acfd-fe237e0f1763 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:53.263030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 852/1714] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 10 11:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:10:53.274953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:53.275494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:53.275494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:53.318235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:53.319476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:53.327874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 863/1715] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:53.374290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400110-f0c7-43de-acfd-fe237e0f1763 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:53.376090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-96400110-f0c7-43de-acfd-fe237e0f1763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:53.406269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400110-f0c7-43de-acfd-fe237e0f1763 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:53.416792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:53.417467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:53.418792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:53.418792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:53.430298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:53.443934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:53.445801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:53.466482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 853/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:10:53.610078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:53.611660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:53.640498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9c57-2ddd-4d9f-bffe-6df34bcd07d6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:53.655079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:53.655758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:53.656030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:53.656296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] PATH_INFO: `/v3/projects/2a0ed213827a4f99a86c003fcb23e26a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:53.660511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0ed213827a4f99a86c003fcb23e26a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:53.662643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:53.744972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0ed213827a4f99a86c003fcb23e26a', 'request_id': 'req-305abe93-93f9-472c-bdcf-b4a1892d8ce7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:53.752379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0ed213827a4f99a86c003fcb23e26a', 'request_id': 'req-305abe93-93f9-472c-bdcf-b4a1892d8ce7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:53.762512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0ed213827a4f99a86c003fcb23e26a', 'request_id': 'req-305abe93-93f9-472c-bdcf-b4a1892d8ce7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:53.775998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] The token cache is being invalidate because project 2a0ed213827a4f99a86c003fcb23e26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:10:53.776600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:53.780146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-305abe93-93f9-472c-bdcf-b4a1892d8ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:53.780146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 864/1717] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:10:53 2022] DELETE /identity/v3/projects/2a0ed213827a4f99a86c003fcb23e26a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:53.783945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:53.802422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37449c49-ea91-43f6-bb58-159fde80a02d service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:53.940955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:53.941650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:53.941896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:53.942159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] PATH_INFO: `/v3/users/e3a90f3666304485a206b8dab1a3196d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:53.943308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a90f3666304485a206b8dab1a3196d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:53.945371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:53.969622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba66dde-d660-4f81-91a1-215355273491 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:53.970420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba66dde-d660-4f81-91a1-215355273491 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:53.970972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba66dde-d660-4f81-91a1-215355273491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:54.072114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8ba66dde-d660-4f81-91a1-215355273491 None None] MFA Rules not processed for user `d01d3fdea0f9451e8301003c34734569`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:54.073392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8ba66dde-d660-4f81-91a1-215355273491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:54.074245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a90f3666304485a206b8dab1a3196d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:54.100815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:54.127412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a90f3666304485a206b8dab1a3196d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:54.181018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a90f3666304485a206b8dab1a3196d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:54.183683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a90f3666304485a206b8dab1a3196d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:54.186309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a90f3666304485a206b8dab1a3196d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:54.224078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 854/1718] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:10:53 2022] DELETE /identity/v3/users/e3a90f3666304485a206b8dab1a3196d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:54.395511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 865/1719] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:55.765700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:55.768265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:56.074974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eede4b-af0b-4927-864b-465fcc47b0ab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:56.102536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:56.111486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:56.112676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:56.113402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] PATH_INFO: `/v3/projects/d5d13727013b4277804cd3afaff9a733` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:56.120640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d13727013b4277804cd3afaff9a733)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:56.125120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:56.199489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:56.319770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d13727013b4277804cd3afaff9a733', 'request_id': 'req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:56.347879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d13727013b4277804cd3afaff9a733', 'request_id': 'req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:56.365171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d13727013b4277804cd3afaff9a733', 'request_id': 'req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:56.415797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] The token cache is being invalidate because project d5d13727013b4277804cd3afaff9a733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:10:56.416140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:56.417582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-67e7988f-e4e6-4384-b0d6-40c3134e3ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:10:56.422687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 855/1720] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:10:55 2022] DELETE /identity/v3/projects/d5d13727013b4277804cd3afaff9a733 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:56.429642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821fc9b-e143-4ff4-86be-d42fffc50cba None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:56.432587 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821fc9b-e143-4ff4-86be-d42fffc50cba None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:56.434598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821fc9b-e143-4ff4-86be-d42fffc50cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:56.497494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0821fc9b-e143-4ff4-86be-d42fffc50cba None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:56.499870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0821fc9b-e143-4ff4-86be-d42fffc50cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:56.708738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:56.708948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:56.709226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:56.735672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 866/1721] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:56.745595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:56.746259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:56.746626 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:56.807044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:56.812350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:56.858532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 867/1722] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:56.863250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:56.896552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a4c5f-c333-43c0-a386-7a694a30c86c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:56.911597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:56.915476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:56.921081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:56.921826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:56.924112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:56.924694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:56.926343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:10:56.929794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:56.935055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:56.967608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 868/1723] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:10:56.983237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:57.017044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6ca35-f513-41db-8c68-7f0b1438aa90 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:57.028929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:57.029790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.030203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.030628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.033934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:57.036315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:57.141761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 869/1724] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:56 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:57.145337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:57.281729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 856/1725] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:57.367985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522fd3-ef47-4a3e-8eb5-94fb17c577f1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:57.379850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:57.381051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.381345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.381921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.389530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:57.410017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:57.483747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 870/1726] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:57 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:57.501319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:57.520363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277de4-a7db-468a-b35f-3edcc4e60c9b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:57.529019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01401bb6-1f9d-431b-b382-7f008aec24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:57.530023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401bb6-1f9d-431b-b382-7f008aec24bf admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.530384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401bb6-1f9d-431b-b382-7f008aec24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.530720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401bb6-1f9d-431b-b382-7f008aec24bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.531498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01401bb6-1f9d-431b-b382-7f008aec24bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:57.533392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01401bb6-1f9d-431b-b382-7f008aec24bf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:57.549389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 857/1727] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:57.554495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:57.563014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:57.570431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481a9c-07c3-4fe7-9c5e-f69a1c00536b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:57.594630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.595093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.595372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.597956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:57.598809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.599158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.599557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.600387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:57.603417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:57.629846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] MFA Rules not processed for user `95398f8ac1ca42c0969b37f54a582e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:57.631122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:57.643807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 871/1728] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:57.645077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:57.654010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:57.737811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 858/1729] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:10:57.737811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:57.757630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094acb-2d35-42bd-8760-673af3cebe3d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:57.782164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693867-a52e-4290-a483-e683cf0d4d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:57.783009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693867-a52e-4290-a483-e683cf0d4d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.783463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693867-a52e-4290-a483-e683cf0d4d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.786118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693867-a52e-4290-a483-e683cf0d4d5d admin admin] PATH_INFO: `/v3/projects/e2f80fe6ed0f4159a86444af66fbaae6/users/04f2471ade0c4d458293d38534f23ef6/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.797868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:57.808502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16693867-a52e-4290-a483-e683cf0d4d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f80fe6ed0f4159a86444af66fbaae6, user_id=04f2471ade0c4d458293d38534f23ef6, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:57.813546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16693867-a52e-4290-a483-e683cf0d4d5d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:57.872856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 859/1730] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:57 2022] PUT /identity/v3/projects/e2f80fe6ed0f4159a86444af66fbaae6/users/04f2471ade0c4d458293d38534f23ef6/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:10:57.879951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:57.881403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:57.881697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:57.899824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ea2a-e16f-4868-8fbd-a81b42d6e539 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:57.991408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] MFA Rules not processed for user `04f2471ade0c4d458293d38534f23ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:57.997514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:10:58.096845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:58.097880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:58.098267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:58.099514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:58.165227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 860/1731] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:10:58.170808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:58.285067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9d96b-60f4-46b8-a937-8cd6c5fa52a1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:58.290219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:58.290886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:58.291160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:58.291424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:58.297386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:58.299324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:58.306683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:58.312059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:58.340951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 872/1732] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:10:58.357327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 861/1733] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:10:58 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:58.365810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:58.381778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337c97-23b5-473b-8a12-3706891e961a service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:58.400822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:58.533670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:58.534479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:58.534957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:58.535411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:58.536196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:58.542156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:58.614996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 873/1734] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:10:58 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:10:58.619674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:58.653029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2a993-e476-4a0f-a16b-e299dc4c6c79 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:58.675512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:58.676152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:58.676431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:58.676705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:58.688300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:58.701375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:58.780098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:58.785308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 862/1735] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:58.794528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed534b8-2004-4007-98ac-a6c9e5f77f4a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:58.834882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:58.835719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:58.836003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:58.836277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] PATH_INFO: `/v3/projects/4f1af2bfe04e4748a98f12a2b3ca58b7/users/3f13bc83e7f24893b83f0e5f34ae6de9/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:58.930454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1af2bfe04e4748a98f12a2b3ca58b7, user_id=3f13bc83e7f24893b83f0e5f34ae6de9, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:58.933555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:58.994493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 874/1736] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:58 2022] PUT /identity/v3/projects/4f1af2bfe04e4748a98f12a2b3ca58b7/users/3f13bc83e7f24893b83f0e5f34ae6de9/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:10:58.998728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:59.015776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1b8f2-00e2-44e9-bd27-d295794137ce admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:59.292566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:59.350748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fcb1d-d16e-4f12-ac77-a48b46fdf68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:59.357642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fcb1d-d16e-4f12-ac77-a48b46fdf68d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:59.357958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fcb1d-d16e-4f12-ac77-a48b46fdf68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:59.363815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fcb1d-d16e-4f12-ac77-a48b46fdf68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:59.364698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fcb1d-d16e-4f12-ac77-a48b46fdf68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:59.366371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fcb1d-d16e-4f12-ac77-a48b46fdf68d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:59.421242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:10:59.431525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 863/1737] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:10:59.448137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdf6bf-2ea8-44f2-9f77-3694566cbc3b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:10:59.474689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:10:59.476480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:59.479149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:59.481737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] PATH_INFO: `/v3/projects/4f1af2bfe04e4748a98f12a2b3ca58b7/users/3f13bc83e7f24893b83f0e5f34ae6de9/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:59.491965 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1af2bfe04e4748a98f12a2b3ca58b7, user_id=3f13bc83e7f24893b83f0e5f34ae6de9, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:10:59.505505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:10:59.595177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 875/1738] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:10:59 2022] PUT /identity/v3/projects/4f1af2bfe04e4748a98f12a2b3ca58b7/users/3f13bc83e7f24893b83f0e5f34ae6de9/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:10:59.605230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:10:59.605582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:10:59.605855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:10:59.738839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] MFA Rules not processed for user `3f13bc83e7f24893b83f0e5f34ae6de9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:10:59.742163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:00.059108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 864/1739] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:00.068190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:00.070297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:00.381354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9b8d-2079-49b1-8d82-f1d2cd238e68 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:00.405259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e7149-dd24-4df4-86fa-2d1d7de6835b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:00.405811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e7149-dd24-4df4-86fa-2d1d7de6835b service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:00.406073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e7149-dd24-4df4-86fa-2d1d7de6835b service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:00.406335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e7149-dd24-4df4-86fa-2d1d7de6835b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:00.436751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e7149-dd24-4df4-86fa-2d1d7de6835b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:00.439875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e7149-dd24-4df4-86fa-2d1d7de6835b service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:00.471139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 876/1740] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:00.885281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:00.932934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e7a5-74ac-48be-88f7-828b4575af7b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:00.993650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:00.999214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:00.999442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:01.004119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:01.330400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:01.337639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:01.388828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 865/1741] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:03.909211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:03.909747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:03.909747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:03.977232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:03.978472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:04.332785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 877/1742] 10.222.0.44 () {58 vars in 1015 bytes} [Wed Aug 10 11:11:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:04.459610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:04.461288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:04.485545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9b86-90c2-4ca5-9bbe-5626c740b91f service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:04.524878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:04.529077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:04.533262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:04.536279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:04.553856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:04.556251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:04.587470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 866/1743] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:04.725759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:04.727756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:04.768121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca341d-84d9-40cf-b453-eab804052691 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:04.784933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863c56-6479-4ac6-9088-179ca4bfad6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:04.785793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863c56-6479-4ac6-9088-179ca4bfad6d service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:04.787357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863c56-6479-4ac6-9088-179ca4bfad6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:04.787840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863c56-6479-4ac6-9088-179ca4bfad6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:04.808933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a863c56-6479-4ac6-9088-179ca4bfad6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:04.816205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a863c56-6479-4ac6-9088-179ca4bfad6d service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:04.839588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 878/1744] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:08.257210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:08.259502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:08.399087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:08.404964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51c7f-ce64-4f3d-bb50-c5cdf3425ec3 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:08.411527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:08.412771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:08.424256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:08.425390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] PATH_INFO: `/v3/users/a4ad9ff4aebb49c790c843af14977229` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:08.427715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ad9ff4aebb49c790c843af14977229)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:08.430083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:08.533613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ad9ff4aebb49c790c843af14977229'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:08.574603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ad9ff4aebb49c790c843af14977229'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:08.594444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ad9ff4aebb49c790c843af14977229'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:08.595725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ad9ff4aebb49c790c843af14977229'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:08.602423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ad9ff4aebb49c790c843af14977229'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:08.627719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 867/1745] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:08 2022] DELETE /identity/v3/users/a4ad9ff4aebb49c790c843af14977229 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:08.632310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:08.633452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:08.633971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:08.684548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:08.689263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:08.694712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:08.813178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 879/1746] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:08.884455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:08.886711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:09.045125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3a807-0099-43ed-a79e-f80e1885e288 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:09.068239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d477e-47af-479f-8216-972d2e60fd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:09.069920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d477e-47af-479f-8216-972d2e60fd37 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:09.070309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d477e-47af-479f-8216-972d2e60fd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:09.070470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d477e-47af-479f-8216-972d2e60fd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:09.097146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d477e-47af-479f-8216-972d2e60fd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:09.098607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d477e-47af-479f-8216-972d2e60fd37 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:09.128839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 868/1747] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:09.602621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:09.604156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:09.621214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fbd49-7009-40b4-af29-2017f55c8f9d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:09.633015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:09.634052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:09.635056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:09.635548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] PATH_INFO: `/v3/users/04f2471ade0c4d458293d38534f23ef6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:09.637545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f2471ade0c4d458293d38534f23ef6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:09.640873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:09.766189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f2471ade0c4d458293d38534f23ef6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:09.777732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f2471ade0c4d458293d38534f23ef6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:09.795942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f2471ade0c4d458293d38534f23ef6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:09.797161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f2471ade0c4d458293d38534f23ef6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:09.797997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0892d112-61e7-4ea6-a730-f3efb9621496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f2471ade0c4d458293d38534f23ef6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:09.821165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 880/1748] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:09 2022] DELETE /identity/v3/users/04f2471ade0c4d458293d38534f23ef6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:09.825866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba33bc-a619-4ceb-8438-73452b686bc2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:09.827457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba33bc-a619-4ceb-8438-73452b686bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:09.827935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba33bc-a619-4ceb-8438-73452b686bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:09.865198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-afba33bc-a619-4ceb-8438-73452b686bc2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:09.879493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-afba33bc-a619-4ceb-8438-73452b686bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.073837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e79ac-d477-4e64-88df-d5ab55e47c28 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:10.074530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e79ac-d477-4e64-88df-d5ab55e47c28 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:10.075117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e79ac-d477-4e64-88df-d5ab55e47c28 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:10.077082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 881/1749] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:11:10.115418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e79ac-d477-4e64-88df-d5ab55e47c28 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:10.117642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf6e79ac-d477-4e64-88df-d5ab55e47c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.124387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 869/1750] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:10.155797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1391eac-114a-4c78-989f-2ada07f9f6d3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:10.156080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1391eac-114a-4c78-989f-2ada07f9f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:10.156375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1391eac-114a-4c78-989f-2ada07f9f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:10.160243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e79ac-d477-4e64-88df-d5ab55e47c28 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:10.178319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:10.178922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:10.179199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:10.179469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] PATH_INFO: `/v3/users/712719c343b547699f7cdbe9c178db5f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:10.181572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712719c343b547699f7cdbe9c178db5f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:10.183703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:10.193430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f1391eac-114a-4c78-989f-2ada07f9f6d3 None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:10.193611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1391eac-114a-4c78-989f-2ada07f9f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.230318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:10.309311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712719c343b547699f7cdbe9c178db5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:10.334815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712719c343b547699f7cdbe9c178db5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:10.382611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712719c343b547699f7cdbe9c178db5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:10.386269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712719c343b547699f7cdbe9c178db5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:10.388751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712719c343b547699f7cdbe9c178db5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:10.399602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:10.434918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 882/1751] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:10 2022] DELETE /identity/v3/users/712719c343b547699f7cdbe9c178db5f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:10.437038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:10.443694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.445901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 870/1752] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:10.447760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:10.448192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:10.448643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:10.494053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:10.495592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.530661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b8da-f09c-41c2-bbbb-de6948fd7183 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:10.535901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:10.536674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:10.536927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:10.537231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:10.539827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.677770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 871/1753] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:10.754923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:10.756741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:10.780531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786c96-a5d6-4eb5-90c8-d203cb43fc19 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:10.799499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9a19e-54e2-4190-8005-89ed31dfaa0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:10.799499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9a19e-54e2-4190-8005-89ed31dfaa0d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:10.799499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9a19e-54e2-4190-8005-89ed31dfaa0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:10.799499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9a19e-54e2-4190-8005-89ed31dfaa0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:10.812743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9a19e-54e2-4190-8005-89ed31dfaa0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:10.820092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9a19e-54e2-4190-8005-89ed31dfaa0d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:10.829227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:10.831103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740956af-e846-4524-bbcb-6536103ffd5b service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:10.854070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 872/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:11:10.897061 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 883/1755] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:11.869532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86ee56-d65d-40d6-8b64-a3153f591294 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:11.870494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86ee56-d65d-40d6-8b64-a3153f591294 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:11.870961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86ee56-d65d-40d6-8b64-a3153f591294 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:11.874505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 873/1756] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:11:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:11:12.021390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:12.022027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:12.022027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:12.060961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:12.066433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:12.322274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 884/1757] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:12.893195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86ee56-d65d-40d6-8b64-a3153f591294 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:12.895864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dd86ee56-d65d-40d6-8b64-a3153f591294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:12.917726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86ee56-d65d-40d6-8b64-a3153f591294 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:12.924260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:12.924890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:12.925189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:12.925451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:12.935479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:12.937196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:12.951620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:12.954354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:12.963891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca62754-6ab4-4e56-bd2c-08051e66060d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:12.977276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:12.979308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:12.979747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:12.980145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] PATH_INFO: `/v3/projects/11a4f6a83bb5417ba9d10c3cba2c268f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:12.985021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a4f6a83bb5417ba9d10c3cba2c268f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:12.986379 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 874/1758] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:12.987247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:13.035087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:13.039367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.066849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:13.075360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff31b6-dd4e-4bd8-b373-6b8754f3b5f0 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:13.091808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a4f6a83bb5417ba9d10c3cba2c268f', 'request_id': 'req-d6492097-b142-498e-90c8-a613f67139d2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.109806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a4f6a83bb5417ba9d10c3cba2c268f', 'request_id': 'req-d6492097-b142-498e-90c8-a613f67139d2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.145888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a4f6a83bb5417ba9d10c3cba2c268f', 'request_id': 'req-d6492097-b142-498e-90c8-a613f67139d2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.160055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] The token cache is being invalidate because project 11a4f6a83bb5417ba9d10c3cba2c268f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:13.160738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.161623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.163935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 885/1759] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:12 2022] DELETE /identity/v3/projects/11a4f6a83bb5417ba9d10c3cba2c268f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:13.167785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:13.169679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.283244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492097-b142-498e-90c8-a613f67139d2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:13.295762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:13.296694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:13.297049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:13.297385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] PATH_INFO: `/v3/users/9c03839df7704fbfa3c913623e2bef8b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:13.298635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c03839df7704fbfa3c913623e2bef8b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:13.300301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:13.301078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:13.301459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:13.302189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:13.302528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] PATH_INFO: `/v3/projects/17ca1d8dd6ec44a7b2ea51af0f7416e0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:13.304525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ca1d8dd6ec44a7b2ea51af0f7416e0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:13.307453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:13.359627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:13.382748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c03839df7704fbfa3c913623e2bef8b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.390962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ca1d8dd6ec44a7b2ea51af0f7416e0', 'request_id': 'req-925b99ef-93b3-481f-a796-5a669adb7ec0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.396692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c03839df7704fbfa3c913623e2bef8b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.409462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ca1d8dd6ec44a7b2ea51af0f7416e0', 'request_id': 'req-925b99ef-93b3-481f-a796-5a669adb7ec0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.418199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c03839df7704fbfa3c913623e2bef8b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.419076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c03839df7704fbfa3c913623e2bef8b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.420478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c03839df7704fbfa3c913623e2bef8b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.420891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ca1d8dd6ec44a7b2ea51af0f7416e0', 'request_id': 'req-925b99ef-93b3-481f-a796-5a669adb7ec0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.440612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 886/1760] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:13 2022] DELETE /identity/v3/users/9c03839df7704fbfa3c913623e2bef8b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:13.440612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:13.442242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.444879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] The token cache is being invalidate because project 17ca1d8dd6ec44a7b2ea51af0f7416e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:13.445957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.446819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.450043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 875/1761] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:13 2022] DELETE /identity/v3/projects/17ca1d8dd6ec44a7b2ea51af0f7416e0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:13.453793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:13.456323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.517815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:13.563089 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b99ef-93b3-481f-a796-5a669adb7ec0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:13.603255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f080617-af96-4cb2-b5bc-0a20894a486d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:13.609187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:13.610013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:13.610663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:13.610663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:13.612802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.626477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:13.628223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:13.638790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:13.639764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:13.640046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:13.640370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] PATH_INFO: `/v3/users/efaf79e374bc49d7b7e15f6767d0ba19` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:13.640995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 887/1762] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:13.641765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efaf79e374bc49d7b7e15f6767d0ba19)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:13.644087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:13.654062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:13.657548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.683330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd70645-c38a-4b72-8f7f-16f81572eb7f service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:13.698070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:13.698718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:13.700836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:13.701240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] PATH_INFO: `/v3/projects/e2f80fe6ed0f4159a86444af66fbaae6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:13.704809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f80fe6ed0f4159a86444af66fbaae6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:13.708504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:13.728310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efaf79e374bc49d7b7e15f6767d0ba19'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.750477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efaf79e374bc49d7b7e15f6767d0ba19'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.752414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:13.780878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efaf79e374bc49d7b7e15f6767d0ba19'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.782975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efaf79e374bc49d7b7e15f6767d0ba19'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.784921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efaf79e374bc49d7b7e15f6767d0ba19'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.807547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f80fe6ed0f4159a86444af66fbaae6', 'request_id': 'req-d720b7e1-7d77-45af-8872-a652c31c4afa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.816909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 876/1763] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:13 2022] DELETE /identity/v3/users/efaf79e374bc49d7b7e15f6767d0ba19 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:13.819344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f80fe6ed0f4159a86444af66fbaae6', 'request_id': 'req-d720b7e1-7d77-45af-8872-a652c31c4afa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.834359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f80fe6ed0f4159a86444af66fbaae6', 'request_id': 'req-d720b7e1-7d77-45af-8872-a652c31c4afa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.855819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] The token cache is being invalidate because project e2f80fe6ed0f4159a86444af66fbaae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:13.856143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.856998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:13.858846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 888/1764] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:13 2022] DELETE /identity/v3/projects/e2f80fe6ed0f4159a86444af66fbaae6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:13.862958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:13.864326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:13.942340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc5903-1f2b-4ac9-a426-e778dc5aa445 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:13.948717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:13.949446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:13.949717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:13.949978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] PATH_INFO: `/v3/users/3f13bc83e7f24893b83f0e5f34ae6de9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:13.951899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f13bc83e7f24893b83f0e5f34ae6de9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:13.954038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.016232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f13bc83e7f24893b83f0e5f34ae6de9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.030002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f13bc83e7f24893b83f0e5f34ae6de9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.040930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f13bc83e7f24893b83f0e5f34ae6de9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.042213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f13bc83e7f24893b83f0e5f34ae6de9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.043133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f13bc83e7f24893b83f0e5f34ae6de9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.071761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 877/1765] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:13 2022] DELETE /identity/v3/users/3f13bc83e7f24893b83f0e5f34ae6de9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:14.234269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.239204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:14.263940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.266424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:14.343430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720b7e1-7d77-45af-8872-a652c31c4afa admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.411351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62021-50d6-4473-a209-0131416f0dd1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.416205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.416849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.417162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.417432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] PATH_INFO: `/v3/projects/ddb2294fc4034d7695e8a0bf48d0da7e` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.418557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb2294fc4034d7695e8a0bf48d0da7e)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.420497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.424219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:14.453131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:14.469648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.471071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.475720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.476207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] PATH_INFO: `/v3/projects/07d7d64e6016430f97bb0f8256f7834b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.478080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d7d64e6016430f97bb0f8256f7834b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.481926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.498611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb2294fc4034d7695e8a0bf48d0da7e', 'request_id': 'req-0fe13ee2-b99b-43e7-b0ab-be8523639569'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.512221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb2294fc4034d7695e8a0bf48d0da7e', 'request_id': 'req-0fe13ee2-b99b-43e7-b0ab-be8523639569'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.525282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb2294fc4034d7695e8a0bf48d0da7e', 'request_id': 'req-0fe13ee2-b99b-43e7-b0ab-be8523639569'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.540142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] The token cache is being invalidate because project ddb2294fc4034d7695e8a0bf48d0da7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:14.540433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.541139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0fe13ee2-b99b-43e7-b0ab-be8523639569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.542681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 878/1766] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:14 2022] DELETE /identity/v3/projects/ddb2294fc4034d7695e8a0bf48d0da7e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:14.547863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fd52d-6743-4d3b-bc5b-e1d7817b9670 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.548147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fd52d-6743-4d3b-bc5b-e1d7817b9670 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.548536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fd52d-6743-4d3b-bc5b-e1d7817b9670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.562546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d7d64e6016430f97bb0f8256f7834b', 'request_id': 'req-cb8cbe88-183f-47df-987f-5c1b1315317e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.572765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d7d64e6016430f97bb0f8256f7834b', 'request_id': 'req-cb8cbe88-183f-47df-987f-5c1b1315317e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.578226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7b7fd52d-6743-4d3b-bc5b-e1d7817b9670 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:14.579633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7b7fd52d-6743-4d3b-bc5b-e1d7817b9670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:14.585818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d7d64e6016430f97bb0f8256f7834b', 'request_id': 'req-cb8cbe88-183f-47df-987f-5c1b1315317e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.610420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] The token cache is being invalidate because project 07d7d64e6016430f97bb0f8256f7834b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:14.610798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.613385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cb8cbe88-183f-47df-987f-5c1b1315317e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:14.616072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 889/1767] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:14 2022] DELETE /identity/v3/projects/07d7d64e6016430f97bb0f8256f7834b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:14.621766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fafd8-f1bb-4a6f-bd25-4d56634dc2ee None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.622711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fafd8-f1bb-4a6f-bd25-4d56634dc2ee None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.624089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fafd8-f1bb-4a6f-bd25-4d56634dc2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.660842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-681fafd8-f1bb-4a6f-bd25-4d56634dc2ee None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:14.662057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-681fafd8-f1bb-4a6f-bd25-4d56634dc2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:14.668408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 879/1768] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:14.676701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.677419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.678079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.680128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 890/1769] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:14.690669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.691023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.691198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.706414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:14.708708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:14.715691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:14.716898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:14.719850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 880/1770] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:14.723877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.731309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 891/1771] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:14.732621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.735360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc321f7d-ef46-4909-b871-cb7f647512a0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.742496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.743240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.743634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.744356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.744754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ac73c-10fe-4c4d-a3b3-4a9919a572a8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.745429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:14.746051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.748106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.750904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.754532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.755013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.755436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.756259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:14.756704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.759093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.765015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 881/1772] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:11:14.769367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.777610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 892/1773] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:14.778879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.781926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beb488-4e6d-495b-9253-4140685cbdc3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.789781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.790723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.791214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.791753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.792588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99356051-c2c1-4012-8039-ac15e0da236a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.792841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.795412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.799334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.800639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.800949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.801359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.801959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.804256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:14.840507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 882/1774] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:14.845122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.854022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 893/1775] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:14.858663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:14.923018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:14.941025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed3c9-9e43-4fa8-82f1-c493f9728cc9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.954431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6477-5d9c-4f66-9160-3b7b9a9600cd admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:14.968419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:14.969123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:14.969397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:14.970136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:14.971838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:14.974013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.005732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 894/1776] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:15.007172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.020062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.020836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.021399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.021399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.022043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.023290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbd3c7-8151-4d92-85ef-044758db926a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.025480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.029111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.029977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.030429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.030988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.031866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.033796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.074487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 883/1777] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:14 2022] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:15.075238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 895/1778] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:15.076173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.076340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.089310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebaa42-6fd9-4c0a-a039-8196bbe1e765 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.094372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.096209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.096668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.097136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.097932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.099713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.101456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c48a-d84c-4c24-913c-b89f47a55050 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.112448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.114923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 884/1779] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:15.119202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.130753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72df3-1f7e-40f7-bf87-21e9867d4dac admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.136599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.136599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.136599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.136865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.138517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.139438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.140297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.140715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.141194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] PATH_INFO: `/v3/projects/b6162cdf5f1a48aa8a68c63bf1c160cb/users/859ae9d3def24f25a7b4486706f4cd57/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.153412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 896/1780] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:15.153412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.157869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.168248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:15.170231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6162cdf5f1a48aa8a68c63bf1c160cb, user_id=859ae9d3def24f25a7b4486706f4cd57, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.173740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f53394-e6e8-47ec-b7be-c6cd4d3fd4a9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.173955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.180614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.181304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.181911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.182726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] PATH_INFO: `/v3/projects/4f1af2bfe04e4748a98f12a2b3ca58b7` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.184076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1af2bfe04e4748a98f12a2b3ca58b7)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.186265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.202533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 885/1781] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:15 2022] PUT /identity/v3/projects/b6162cdf5f1a48aa8a68c63bf1c160cb/users/859ae9d3def24f25a7b4486706f4cd57/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:15.203777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.269516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1af2bfe04e4748a98f12a2b3ca58b7', 'request_id': 'req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:15.279695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1af2bfe04e4748a98f12a2b3ca58b7', 'request_id': 'req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:15.294456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1af2bfe04e4748a98f12a2b3ca58b7', 'request_id': 'req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:15.315286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] The token cache is being invalidate because project 4f1af2bfe04e4748a98f12a2b3ca58b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:15.316208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:15.317429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-74a5fbd6-4197-4ab6-a319-d6b9038b4cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:15.319393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 897/1782] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:15 2022] DELETE /identity/v3/projects/4f1af2bfe04e4748a98f12a2b3ca58b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:15.321328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec3242-9917-4114-9cef-1af3e53224a6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.324228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7f297-011a-4c0d-93c1-46639b8a856f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.324581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7f297-011a-4c0d-93c1-46639b8a856f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.325110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7f297-011a-4c0d-93c1-46639b8a856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.382393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-73f7f297-011a-4c0d-93c1-46639b8a856f None None] MFA Rules not processed for user `859ae9d3def24f25a7b4486706f4cd57`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:15.383795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-73f7f297-011a-4c0d-93c1-46639b8a856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.445264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999db3-d3f3-4e81-b631-5c1562728e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.446268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999db3-d3f3-4e81-b631-5c1562728e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.446542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999db3-d3f3-4e81-b631-5c1562728e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.446807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999db3-d3f3-4e81-b631-5c1562728e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.447453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999db3-d3f3-4e81-b631-5c1562728e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.449074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999db3-d3f3-4e81-b631-5c1562728e4d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.453396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:15.483111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 886/1783] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:15.487117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348435-e599-49cc-aa36-0025499adc47 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.487404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348435-e599-49cc-aa36-0025499adc47 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.487676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348435-e599-49cc-aa36-0025499adc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.514609 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-75348435-e599-49cc-aa36-0025499adc47 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:15.516034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-75348435-e599-49cc-aa36-0025499adc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.530660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 887/1784] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:15.530660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75348435-e599-49cc-aa36-0025499adc47 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.530660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-75348435-e599-49cc-aa36-0025499adc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.538334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 898/1785] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:15.539590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.539870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.540137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.547101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75348435-e599-49cc-aa36-0025499adc47 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.555324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.556843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.557439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.558000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] PATH_INFO: `/v3/projects/b4e2d558375b43afbf79cfef698da33c/users/dcfba2aab1bb4b78af41de1ea7abac5f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.574674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:15.576489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.581934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e2d558375b43afbf79cfef698da33c, user_id=dcfba2aab1bb4b78af41de1ea7abac5f, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.585519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.590294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 899/1786] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:15.590294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.590294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.606546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa21865-d9f6-4b3a-a207-97f7a40acdd6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.612490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc4932-61a1-4915-9179-d8487fd7a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.613218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4932-61a1-4915-9179-d8487fd7a929 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.614068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4932-61a1-4915-9179-d8487fd7a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.614205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4932-61a1-4915-9179-d8487fd7a929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.615010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc4932-61a1-4915-9179-d8487fd7a929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.617126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc4932-61a1-4915-9179-d8487fd7a929 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.640943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 888/1787] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:15 2022] PUT /identity/v3/projects/b4e2d558375b43afbf79cfef698da33c/users/dcfba2aab1bb4b78af41de1ea7abac5f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:15.641825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.658782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 900/1788] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:15.658782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.658782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.658782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.700015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] MFA Rules not processed for user `dcfba2aab1bb4b78af41de1ea7abac5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:15.701507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:15.740636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6cfe-ad79-451b-b2a3-203da452aac8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.747817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:15.800615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 901/1789] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:15.802850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.815295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.816463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.816751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.818620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.820018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:15.821095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.823082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.845161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 889/1790] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:15.846038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.856547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0359d-66e8-4bd3-a783-fce6053a42c3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.861117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.861747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.862067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.862330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.862945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.864824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.889873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a0f7c-b68f-490b-a923-50d87d6635eb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.895354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.895960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.896229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.896582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.897269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.900951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 890/1791] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:15.900951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.901316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.925098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 902/1792] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:15.925098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:15.935340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c232f-bc54-43ef-ac91-06df9b36611e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.950456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:15.968078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784bcb-701f-4e19-8751-be8dd5f2faf1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:15.973024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.973667 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.973920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.974196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.974865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:15.976764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:15.997979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:15.998693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:15.999006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:15.999276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:15.999905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.002605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.004435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 891/1793] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:16.005447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.028563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 903/1794] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:15 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:16.029552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.043637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97414f43-35e5-4615-a374-0efafcfd6c80 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.082931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd5c6-e83f-443c-a314-3a8d557a15cd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.091606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.092706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.093465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.093465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.094315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.096584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.107285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:16.113711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 892/1795] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:16.114633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.119707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.120532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.122746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.123294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.124785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.127573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.128138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdba94-6422-42c3-8c28-7e7c3c3d526b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.135357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.135980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.136257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.136527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.137203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.138801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.150292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 893/1796] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:16.151278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.156542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 904/1797] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:16 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:16.157729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.161286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d36a7-233a-4261-899e-83c5e35fefb9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.166413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.167059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.167333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.167598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] PATH_INFO: `/v3/projects/5870fc9c69264790bdf31a472575a539/users/fda5de18492c4f78a2cefed0e855e811/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.167842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd1e6d-19d4-4750-9905-70d20974d208 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.172859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.173518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.173794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.174057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] PATH_INFO: `/v3/projects/9910c800b9f14dd1befff3cba773d57c/users/7dd6e838f8144531b70739521ab0e3e0/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.182773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5870fc9c69264790bdf31a472575a539, user_id=fda5de18492c4f78a2cefed0e855e811, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.185457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.188929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9910c800b9f14dd1befff3cba773d57c, user_id=7dd6e838f8144531b70739521ab0e3e0, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.191701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.199847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 894/1798] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:16 2022] PUT /identity/v3/projects/5870fc9c69264790bdf31a472575a539/users/fda5de18492c4f78a2cefed0e855e811/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:16.200658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.204955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 905/1799] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:16 2022] PUT /identity/v3/projects/9910c800b9f14dd1befff3cba773d57c/users/7dd6e838f8144531b70739521ab0e3e0/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:16.205658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.264813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7de7-3a44-474f-ac85-18fc91405507 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.268509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e683-7fdd-4277-b2aa-1ea75e1fb282 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.269985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.270674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.271042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.271313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.271963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.273115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.273584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.273672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.273966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.274229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.274852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.276414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.284506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 895/1800] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:16.285336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.289385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 906/1801] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:16.290083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.294831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacae01-245b-4447-8584-3b72de8f8c2f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.299690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e32b90-3682-4d77-8405-fa3007656fb8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.300453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.301063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.301370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.301635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.302259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.303826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.304369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.304925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.305847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.306333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.307121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.308873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.318053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 896/1802] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:16.318053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.323365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 907/1803] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:16.325914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.328820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778738c-cafc-4427-a091-3648dbb10a50 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.334444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.335124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.335453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.339240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9450-b416-4ba0-91b9-020b6ab81d55 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.346075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] PATH_INFO: `/v3/projects/5870fc9c69264790bdf31a472575a539/users/fda5de18492c4f78a2cefed0e855e811/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.353519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13d571-a0f0-48bf-8129-e4d7f35a8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.354512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13d571-a0f0-48bf-8129-e4d7f35a8354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.354832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13d571-a0f0-48bf-8129-e4d7f35a8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.355099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13d571-a0f0-48bf-8129-e4d7f35a8354 admin admin] PATH_INFO: `/v3/projects/9910c800b9f14dd1befff3cba773d57c/users/7dd6e838f8144531b70739521ab0e3e0/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.355208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5870fc9c69264790bdf31a472575a539, user_id=fda5de18492c4f78a2cefed0e855e811, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.358208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.358344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13d571-a0f0-48bf-8129-e4d7f35a8354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9910c800b9f14dd1befff3cba773d57c, user_id=7dd6e838f8144531b70739521ab0e3e0, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.366434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13d571-a0f0-48bf-8129-e4d7f35a8354 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.371401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 897/1804] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:16 2022] PUT /identity/v3/projects/5870fc9c69264790bdf31a472575a539/users/fda5de18492c4f78a2cefed0e855e811/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:16.373118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.386506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:16.399882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 908/1805] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:16 2022] PUT /identity/v3/projects/9910c800b9f14dd1befff3cba773d57c/users/7dd6e838f8144531b70739521ab0e3e0/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:16.399882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87615d-9b56-4e29-8740-f21842cd35fc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.399882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87615d-9b56-4e29-8740-f21842cd35fc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.399882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87615d-9b56-4e29-8740-f21842cd35fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.423554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9e87615d-9b56-4e29-8740-f21842cd35fc None None] MFA Rules not processed for user `fda5de18492c4f78a2cefed0e855e811`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:16.424863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9e87615d-9b56-4e29-8740-f21842cd35fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:16.507857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd78b8-0b72-4fd9-a1d9-748b87deaca3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.512403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 909/1806] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:16.518003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ca3af-bd0a-4810-bbda-6bfd4043e83a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.518003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ca3af-bd0a-4810-bbda-6bfd4043e83a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.518003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ca3af-bd0a-4810-bbda-6bfd4043e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.552002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3a3ca3af-bd0a-4810-bbda-6bfd4043e83a None None] MFA Rules not processed for user `7dd6e838f8144531b70739521ab0e3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:16.553253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3a3ca3af-bd0a-4810-bbda-6bfd4043e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:16.560918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:16.576215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.576888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.577190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.577457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] PATH_INFO: `/v3/projects/b2cbe72f917749848ed006e6abd5840b/users/43bf10a6a2f447018ab281655b103df2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.596772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cbe72f917749848ed006e6abd5840b, user_id=43bf10a6a2f447018ab281655b103df2, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.601005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.618163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 898/1807] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:16 2022] PUT /identity/v3/projects/b2cbe72f917749848ed006e6abd5840b/users/43bf10a6a2f447018ab281655b103df2/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:16.627981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.629604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:16.647243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 910/1808] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:16.648825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.649155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.649424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.689686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] MFA Rules not processed for user `43bf10a6a2f447018ab281655b103df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:16.691149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:16.715254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e239d-1c70-4527-8c82-98c77b442b5d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.721633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.721633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.721886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.722141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.775943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 911/1809] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:16.776812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.778747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:16.790418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:16.792384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a3b46-cc65-459e-8531-222ea50ad975 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.797414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.797905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.798183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.798447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.815880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.817528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.834016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 899/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:16.874042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.883114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434eb94-35ef-44f2-bc55-618c343e4f3a service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:16.887135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:16.887735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:16.888005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:16.888316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:16.892413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.894113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.898305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:16.899620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:16.907049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 912/1811] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:16.908766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 900/1812] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:11:16.930596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:16.969617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:17.015474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b9ae1-e5e7-413e-be62-e66a129ef922 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.022310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.023016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.023340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.023608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] PATH_INFO: `/v3/users/43bf10a6a2f447018ab281655b103df2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.025207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bf10a6a2f447018ab281655b103df2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.027330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.034102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.045519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ef74-11d7-4647-86e2-aa90298537a4 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.050202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.051519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.052000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.052442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.096931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bf10a6a2f447018ab281655b103df2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.129165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bf10a6a2f447018ab281655b103df2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.150979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bf10a6a2f447018ab281655b103df2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.152334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bf10a6a2f447018ab281655b103df2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.152955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d60e9ec3-2207-4332-99b0-e332a95ef05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bf10a6a2f447018ab281655b103df2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.154975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.158447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.172236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 913/1813] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:16 2022] DELETE /identity/v3/users/43bf10a6a2f447018ab281655b103df2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:17.172386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 901/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:17.175443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349641-7988-490d-8445-d6960be88d46 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.176067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349641-7988-490d-8445-d6960be88d46 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.176282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349641-7988-490d-8445-d6960be88d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.200248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e3349641-7988-490d-8445-d6960be88d46 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:17.201479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e3349641-7988-490d-8445-d6960be88d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:17.298763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 914/1815] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:17.309502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.316380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:17.361902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349641-7988-490d-8445-d6960be88d46 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.363389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e3349641-7988-490d-8445-d6960be88d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:17.399919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f0f6-eee8-4e7c-a4fa-59401fbe11d1 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.445547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:17.459894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.461179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.461179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.461179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.467698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349641-7988-490d-8445-d6960be88d46 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.471873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.473664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.474770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda5de18492c4f78a2cefed0e855e811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870fc9c69264790bdf31a472575a539', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.475564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.476067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.476475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.477381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:17.477821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.479826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.485548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 902/1816] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:17.497573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.499819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 915/1817] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:11:17.509703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674f2bb-d6c6-4bec-980b-97bcc47ad291 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.514866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda5de18492c4f78a2cefed0e855e811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870fc9c69264790bdf31a472575a539', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.515724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.516149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.516566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.517397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.519791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.551191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 903/1818] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:17 2022] POST /identity/v3/projects => generated 354 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:17.556188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.567927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7d4c-9fa2-477b-9de8-a5fc09d763b6 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.636602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda5de18492c4f78a2cefed0e855e811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870fc9c69264790bdf31a472575a539', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.637265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.637548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.637946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.638618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:17.638925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.640775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.653999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 916/1819] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:17.695196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.702340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:17.706423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6819-1d3c-4d0c-aa91-72c04228d547 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.712606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda5de18492c4f78a2cefed0e855e811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870fc9c69264790bdf31a472575a539', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:17.713594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:17.713875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:17.714147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] PATH_INFO: `/v3/projects/22977fb2db2e47bab4350c184b18f565` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:17.715326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22977fb2db2e47bab4350c184b18f565)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:17.717716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:17.772777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22977fb2db2e47bab4350c184b18f565', 'request_id': 'req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.787873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:17.790229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:17.878604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35555ec4-7fd3-4fc1-9348-90eba92e1eb7 tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:17.944636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22977fb2db2e47bab4350c184b18f565', 'request_id': 'req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.953793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22977fb2db2e47bab4350c184b18f565', 'request_id': 'req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.983364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] The token cache is being invalidate because project 22977fb2db2e47bab4350c184b18f565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:17.983904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.984889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2f9b33c4-026b-41b3-b6b5-5f620103b8ae tempest-VolumeQuotaClassesTest-617068926 tempest-VolumeQuotaClassesTest-617068926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:17.986888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 904/1820] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:17 2022] DELETE /identity/v3/projects/22977fb2db2e47bab4350c184b18f565 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:17.993531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.001817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.002256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.002581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] PATH_INFO: `/v3/projects/b2cbe72f917749848ed006e6abd5840b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.003955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cbe72f917749848ed006e6abd5840b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.008535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.065821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:18.117067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cbe72f917749848ed006e6abd5840b', 'request_id': 'req-69f8266a-5286-468d-9658-e6e17f52b839'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.131349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cbe72f917749848ed006e6abd5840b', 'request_id': 'req-69f8266a-5286-468d-9658-e6e17f52b839'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.154447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cbe72f917749848ed006e6abd5840b', 'request_id': 'req-69f8266a-5286-468d-9658-e6e17f52b839'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.203516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] The token cache is being invalidate because project b2cbe72f917749848ed006e6abd5840b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:18.204132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.204963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.212768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 917/1821] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:17 2022] DELETE /identity/v3/projects/b2cbe72f917749848ed006e6abd5840b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:18.214573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134256-8d39-4500-82e1-f203d77d8fb3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.215014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134256-8d39-4500-82e1-f203d77d8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.215105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134256-8d39-4500-82e1-f203d77d8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.243984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-97134256-8d39-4500-82e1-f203d77d8fb3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:18.246329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-97134256-8d39-4500-82e1-f203d77d8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.354318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.355949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.361274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 905/1822] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:18.370890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.371162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.371841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.375972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8266a-5286-468d-9658-e6e17f52b839 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.388377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.389060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.389338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.389611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] PATH_INFO: `/v3/users/859ae9d3def24f25a7b4486706f4cd57` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.391630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859ae9d3def24f25a7b4486706f4cd57)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.393729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.395101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:18.397173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.413627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 906/1823] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:18.418068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.432363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb24c4-aca8-4f8c-95b2-df4e86e30d37 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.437284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.438135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.438135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.438426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.439178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:18.439484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.441259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.456275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 907/1824] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:11:18.461956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.478697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859ae9d3def24f25a7b4486706f4cd57'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.480862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508053-242f-4b02-8092-2e31c897fba0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.486059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.486948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.487306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.487692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.488416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.490029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859ae9d3def24f25a7b4486706f4cd57'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.490834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.512433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859ae9d3def24f25a7b4486706f4cd57'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.513394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859ae9d3def24f25a7b4486706f4cd57'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.514065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8fcad106-5b69-4b63-9712-09f754525ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859ae9d3def24f25a7b4486706f4cd57'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:18.533975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 918/1825] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:18 2022] DELETE /identity/v3/users/859ae9d3def24f25a7b4486706f4cd57 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:18.534213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 908/1826] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:18 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:18.537542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.538011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.538392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.538751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.540317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.559240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:18.560677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.593492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:18.616815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c130aa9-5eff-46d7-b07e-ae734b186769 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.633182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 919/1827] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:18.650825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.658202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.689261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:18.691998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.692943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.693422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.693728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.694479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.696910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.727791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 909/1828] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:18 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:18.727960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01367f8-5427-4ad9-9858-bdfa72401407 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.728764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.731590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.732365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.732631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.732897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.739154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babc5ef-7ae3-4021-b37a-8ad4e3cc6d8e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.742580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.744412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.744833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.745479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.745753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.746144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.746793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.748378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.756204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 920/1829] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:18.761429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 910/1830] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:18.765336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.775480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c3eb-8857-4fe5-b7ea-492c82a4ddd7 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.780100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb1258-a318-40a8-9bd3-87354a5ac0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.780690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb1258-a318-40a8-9bd3-87354a5ac0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.781001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb1258-a318-40a8-9bd3-87354a5ac0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.781264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb1258-a318-40a8-9bd3-87354a5ac0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.781896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb1258-a318-40a8-9bd3-87354a5ac0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.783485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb1258-a318-40a8-9bd3-87354a5ac0cd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.797668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 921/1831] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:18.799990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:18.816771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d211d6-8123-403c-9214-bc3ed564a139 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:18.822884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:18.823712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.824020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.824294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] PATH_INFO: `/v3/projects/11d41e9ecbb64d8c851053718a72a5c5/users/b6f42fd560f0426ca408e2b9f2320710/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.848508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d41e9ecbb64d8c851053718a72a5c5, user_id=b6f42fd560f0426ca408e2b9f2320710, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:18.852015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:18.873068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 911/1832] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:18 2022] PUT /identity/v3/projects/11d41e9ecbb64d8c851053718a72a5c5/users/b6f42fd560f0426ca408e2b9f2320710/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:18.882045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:18.882301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:18.882567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:18.918654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] MFA Rules not processed for user `b6f42fd560f0426ca408e2b9f2320710`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:18.920740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:18.995786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 922/1833] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:19.007565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:19.009431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:19.094365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fbb8a-354f-4ddc-8c0c-40c435e19f5c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:19.099272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:19.099902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:19.100247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:19.100520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:19.111810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:19.113299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:19.125032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 912/1834] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:19.317892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:19.319744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:19.429661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e0f7-e147-4a98-a5c6-e0afc6bedc3e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:19.434440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:19.435156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:19.435498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:19.435837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] PATH_INFO: `/v3/projects/b6162cdf5f1a48aa8a68c63bf1c160cb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:19.437096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6162cdf5f1a48aa8a68c63bf1c160cb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:19.439082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:19.504282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:19.507438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6162cdf5f1a48aa8a68c63bf1c160cb', 'request_id': 'req-1e43f6d5-b6c7-4477-a451-66e9df601331'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.518723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6162cdf5f1a48aa8a68c63bf1c160cb', 'request_id': 'req-1e43f6d5-b6c7-4477-a451-66e9df601331'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.534137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6162cdf5f1a48aa8a68c63bf1c160cb', 'request_id': 'req-1e43f6d5-b6c7-4477-a451-66e9df601331'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.557955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] The token cache is being invalidate because project b6162cdf5f1a48aa8a68c63bf1c160cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:19.559137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.560139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1e43f6d5-b6c7-4477-a451-66e9df601331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.563071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 923/1835] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:19 2022] DELETE /identity/v3/projects/b6162cdf5f1a48aa8a68c63bf1c160cb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:19.567549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:19.583671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf0537-376f-4e0a-b5e5-56d308c66d5a service glance] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:19.630013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:19.672510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:19.674971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:19.675304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:19.675686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] PATH_INFO: `/v3/users/fda5de18492c4f78a2cefed0e855e811` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:19.677091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda5de18492c4f78a2cefed0e855e811)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:19.679209 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:19.804767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda5de18492c4f78a2cefed0e855e811'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.851775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda5de18492c4f78a2cefed0e855e811'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.866308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd82a2-a4ab-4283-b2f7-7d7b9f44c97c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:19.866308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd82a2-a4ab-4283-b2f7-7d7b9f44c97c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:19.866308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd82a2-a4ab-4283-b2f7-7d7b9f44c97c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:19.867710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 924/1836] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:11:19.869419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda5de18492c4f78a2cefed0e855e811'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.870482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda5de18492c4f78a2cefed0e855e811'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.871283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda5de18492c4f78a2cefed0e855e811'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:19.891885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 913/1837] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:19 2022] DELETE /identity/v3/users/fda5de18492c4f78a2cefed0e855e811 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:19.899704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:19.900284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:19.900879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:19.987034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:19.998029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:20.216179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 925/1838] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:11:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:20.418994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:20.420518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:20.450135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520445-ef66-468f-ba6d-2316b30054d3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:20.458212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bc28f-9cff-4f9a-97fc-b5a2a36cc3fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:20.458853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bc28f-9cff-4f9a-97fc-b5a2a36cc3fc service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:20.459129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bc28f-9cff-4f9a-97fc-b5a2a36cc3fc service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:20.459397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bc28f-9cff-4f9a-97fc-b5a2a36cc3fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:20.473827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bc28f-9cff-4f9a-97fc-b5a2a36cc3fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:20.475792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bc28f-9cff-4f9a-97fc-b5a2a36cc3fc service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:20.520427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 914/1839] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:21.426254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:21.427794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:21.654340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366797-2aff-40e4-a9a0-35b8655d9c0f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:21.661345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:21.662375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:21.670867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:21.672033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] PATH_INFO: `/v3/projects/5870fc9c69264790bdf31a472575a539` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:21.674352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5870fc9c69264790bdf31a472575a539)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:21.678997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:21.766168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5870fc9c69264790bdf31a472575a539', 'request_id': 'req-e359bce9-616d-4796-a31d-ce957dc96117'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:21.775129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5870fc9c69264790bdf31a472575a539', 'request_id': 'req-e359bce9-616d-4796-a31d-ce957dc96117'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:21.787914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5870fc9c69264790bdf31a472575a539', 'request_id': 'req-e359bce9-616d-4796-a31d-ce957dc96117'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:21.804047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:21.813365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] The token cache is being invalidate because project 5870fc9c69264790bdf31a472575a539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:21.813877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:21.815224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e359bce9-616d-4796-a31d-ce957dc96117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:21.820265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 926/1840] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:21 2022] DELETE /identity/v3/projects/5870fc9c69264790bdf31a472575a539 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:21.826659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:21.827299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:21.828650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:21.858955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:21.860679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:21.956294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 915/1841] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:21.968497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:21.970407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:21.970407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.038091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:22.041419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:22.057759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 927/1842] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:22.058066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.072612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094cae1-d5b1-4bca-956d-c498660d839f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.083734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.084846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.087192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.087192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.101248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:22.101248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.101248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.129150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 916/1843] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:22.134712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.174866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfe995-a247-4003-9fe5-ac6fb35aa604 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.182028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.182805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.183135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.184886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.185651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.188106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.247025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 928/1844] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:22 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:22.251265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.271628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0267c9-f416-4cd1-8486-5da3f82ac999 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.300763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:22.354588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.355254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.355527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.355806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.356510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.358491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.396995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 917/1845] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:22 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:22.400170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.417565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f82e7-e556-4247-a4ad-6d9604f38923 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.424696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.425506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.426432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.426977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.427345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.429067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.444779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 929/1846] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:22.452272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.465937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee1f87-edf4-468d-9c35-7f8a843f6767 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.470946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac6d1d-a243-45bf-8d2b-d129cfbe4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.471734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6d1d-a243-45bf-8d2b-d129cfbe4edf admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.473058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6d1d-a243-45bf-8d2b-d129cfbe4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.473058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6d1d-a243-45bf-8d2b-d129cfbe4edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.473506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6d1d-a243-45bf-8d2b-d129cfbe4edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.476006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6d1d-a243-45bf-8d2b-d129cfbe4edf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.494764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.502468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 918/1847] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:22.507051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d3fc2-2aa5-4c63-851f-174adab738af admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.511940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.512721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.513122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.513891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] PATH_INFO: `/v3/projects/d892d6cd9e1944ea856c0b49b8eedb7e/users/ca78ee10f9c44df8a32c9870635515ba/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.541562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d892d6cd9e1944ea856c0b49b8eedb7e, user_id=ca78ee10f9c44df8a32c9870635515ba, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.544446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.578916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.579189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.579456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.582693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 930/1848] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:22 2022] PUT /identity/v3/projects/d892d6cd9e1944ea856c0b49b8eedb7e/users/ca78ee10f9c44df8a32c9870635515ba/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:22.615449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] MFA Rules not processed for user `ca78ee10f9c44df8a32c9870635515ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:22.616889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:22.696036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 919/1849] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:22.700597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.764674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1504f-bd1a-4fab-81a8-1eb3ff407ffd admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.769528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.770110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.770385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.770636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.771245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.773234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.803955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 931/1850] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:22 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:22.808021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.819761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff84d-882b-4271-a539-639915455fc7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.881694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.882593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.882765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.883049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.883683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.886021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.915692 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 920/1851] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:22 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:22.916923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.927480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589da79-bdc2-417a-baed-b3a2bc5cb5e4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.934078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.934875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.935240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.935579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.938722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.940443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.952290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 932/1852] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:22.956584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:22.967486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b44f3-6df6-4a5a-acaf-bb509bfcf7da admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:22.972839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec86891-bac3-4b58-9519-747d3358023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:22.977239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86891-bac3-4b58-9519-747d3358023a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:22.977239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86891-bac3-4b58-9519-747d3358023a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:22.977239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86891-bac3-4b58-9519-747d3358023a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:22.977239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec86891-bac3-4b58-9519-747d3358023a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:22.977239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec86891-bac3-4b58-9519-747d3358023a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:22.992690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 921/1853] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:22.997267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.008070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440d0d-3104-43c7-a247-34e8bf7ba607 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.015184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.016892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.017932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.018290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] PATH_INFO: `/v3/projects/083c2011762346f3b27dc4b5138e4c64/users/dad855cf0b8845bfad4103c8ad953ffd/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.043437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083c2011762346f3b27dc4b5138e4c64, user_id=dad855cf0b8845bfad4103c8ad953ffd, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.046143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.060447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 933/1854] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:22 2022] PUT /identity/v3/projects/083c2011762346f3b27dc4b5138e4c64/users/dad855cf0b8845bfad4103c8ad953ffd/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:23.083805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.084087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.084509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.107165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:23.116360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] MFA Rules not processed for user `dad855cf0b8845bfad4103c8ad953ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:23.118401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:23.218905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 922/1855] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:23.223717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.275764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:23.298199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eabd7c-cca4-4cb8-ba60-3af9a1287b24 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.303496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.304140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.304415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.304844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.305519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.307532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.346940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 934/1856] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:23 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:23.351122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.366076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c11cd8-50cd-4a55-b8be-f5c9d36212be None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.430700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.431406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.431586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.431864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.432482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.434452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.468858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 923/1857] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:23 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:23.473157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.483975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e3c24-3dd1-4c83-b570-787f9be93e01 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.488510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.489124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.489397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.489661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.490334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.500081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.512268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 935/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:23.516516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.526979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac7b2-f7d1-4bfe-a773-1a274e11a638 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.532308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.533178 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.533506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.533802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] PATH_INFO: `/v3/projects/300b6227886842b88a49244e923fd78a/users/24cbd5ce82b1406fbee1b665987288f7/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.554133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300b6227886842b88a49244e923fd78a, user_id=24cbd5ce82b1406fbee1b665987288f7, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.560820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.577102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 924/1859] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:23 2022] PUT /identity/v3/projects/300b6227886842b88a49244e923fd78a/users/24cbd5ce82b1406fbee1b665987288f7/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:23.580943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.590845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b993052-ac7d-430b-8057-94e94cac3afd admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.653095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60cc4e-a06f-46b8-9d08-fef7caf06e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.653722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60cc4e-a06f-46b8-9d08-fef7caf06e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.654045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60cc4e-a06f-46b8-9d08-fef7caf06e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.654326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60cc4e-a06f-46b8-9d08-fef7caf06e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.655166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60cc4e-a06f-46b8-9d08-fef7caf06e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.656805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60cc4e-a06f-46b8-9d08-fef7caf06e08 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.668122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 936/1860] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:23.673853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.685139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcacdd-4277-4713-9790-507c1a642fd6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.691433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.692357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.692834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.693244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] PATH_INFO: `/v3/projects/300b6227886842b88a49244e923fd78a/users/24cbd5ce82b1406fbee1b665987288f7/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.695253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300b6227886842b88a49244e923fd78a, user_id=24cbd5ce82b1406fbee1b665987288f7, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.698317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:23.714827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 925/1861] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:23 2022] PUT /identity/v3/projects/300b6227886842b88a49244e923fd78a/users/24cbd5ce82b1406fbee1b665987288f7/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:23.725406 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.726006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.726519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.769192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] MFA Rules not processed for user `24cbd5ce82b1406fbee1b665987288f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:23.770511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:23.879013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 937/1862] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:23.890618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:23.892794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:23.977389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e151a2-4d6e-4105-b78b-f075c6b12043 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:23.982633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:23.983414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:23.983831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:23.984240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:23.993504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:23.997700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:23.999516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:24.013164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 926/1863] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:24.061416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:24.062897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:24.088069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c2df7-860c-48c5-a2ae-6993e8cbb522 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:24.093159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a521ec-8045-4cd4-a24c-4197ad3bfe7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:24.094055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a521ec-8045-4cd4-a24c-4197ad3bfe7d service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:24.094546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a521ec-8045-4cd4-a24c-4197ad3bfe7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:24.094907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a521ec-8045-4cd4-a24c-4197ad3bfe7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:24.143270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:24.163132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a521ec-8045-4cd4-a24c-4197ad3bfe7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:24.166456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a521ec-8045-4cd4-a24c-4197ad3bfe7d service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:24.182562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 938/1864] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:24.523767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:24.525399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:24.707713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657715-27d0-43c4-b362-7b16f33dd9d8 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:24.736722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:24.738070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:24.738703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:24.739349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] PATH_INFO: `/v3/users/dcfba2aab1bb4b78af41de1ea7abac5f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:24.741554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfba2aab1bb4b78af41de1ea7abac5f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:24.745796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:24.929512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfba2aab1bb4b78af41de1ea7abac5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:24.954356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfba2aab1bb4b78af41de1ea7abac5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:24.977925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfba2aab1bb4b78af41de1ea7abac5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:24.978873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfba2aab1bb4b78af41de1ea7abac5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:24.980002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfba2aab1bb4b78af41de1ea7abac5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.008285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 927/1865] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:24 2022] DELETE /identity/v3/users/dcfba2aab1bb4b78af41de1ea7abac5f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:25.010261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:25.010779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:25.010870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:25.038798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:25.040422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:25.122490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 939/1866] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:25.133277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:25.134954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:25.203722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf636-b6b6-4812-aaa5-97fd06011c89 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:25.207885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:25.208787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:25.209296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:25.209616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:25.220131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:25.221872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:25.232190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 928/1867] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:25.528046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:25.529684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:25.543939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b214-1e72-4e4f-a5ce-eed80f2973bb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:25.549385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:25.550188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:25.550621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:25.550883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] PATH_INFO: `/v3/projects/b4e2d558375b43afbf79cfef698da33c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:25.552329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e2d558375b43afbf79cfef698da33c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:25.554357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:25.605485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e2d558375b43afbf79cfef698da33c', 'request_id': 'req-450cd982-4bfe-498a-b44f-c654e2c0444e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.615095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e2d558375b43afbf79cfef698da33c', 'request_id': 'req-450cd982-4bfe-498a-b44f-c654e2c0444e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.623912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e2d558375b43afbf79cfef698da33c', 'request_id': 'req-450cd982-4bfe-498a-b44f-c654e2c0444e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.634679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] The token cache is being invalidate because project b4e2d558375b43afbf79cfef698da33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:25.634970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.635599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.637389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 940/1868] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:25 2022] DELETE /identity/v3/projects/b4e2d558375b43afbf79cfef698da33c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:25.641235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:25.651220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346915ad-7013-4878-ba44-ac7726513e0d service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:25.666504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:25.722068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:25.722720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:25.722996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:25.723262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] PATH_INFO: `/v3/users/7dd6e838f8144531b70739521ab0e3e0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:25.724461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd6e838f8144531b70739521ab0e3e0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:25.726434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:25.779411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd6e838f8144531b70739521ab0e3e0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.796776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd6e838f8144531b70739521ab0e3e0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.804916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd6e838f8144531b70739521ab0e3e0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.805717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd6e838f8144531b70739521ab0e3e0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.806368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1342611d-137b-4d2c-a8cd-f237d83ca9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd6e838f8144531b70739521ab0e3e0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:25.830323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 929/1869] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:25 2022] DELETE /identity/v3/users/7dd6e838f8144531b70739521ab0e3e0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:26.630082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:26.633782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:26.648059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd982-4bfe-498a-b44f-c654e2c0444e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:26.712443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:26.713173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:26.713444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:26.713714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] PATH_INFO: `/v3/projects/9910c800b9f14dd1befff3cba773d57c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:26.714821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9910c800b9f14dd1befff3cba773d57c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:26.716959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:26.719308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:26.784201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9910c800b9f14dd1befff3cba773d57c', 'request_id': 'req-008501e8-b614-4215-9c77-1101ce99690c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:26.793428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9910c800b9f14dd1befff3cba773d57c', 'request_id': 'req-008501e8-b614-4215-9c77-1101ce99690c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:26.804810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9910c800b9f14dd1befff3cba773d57c', 'request_id': 'req-008501e8-b614-4215-9c77-1101ce99690c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:26.839727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] The token cache is being invalidate because project 9910c800b9f14dd1befff3cba773d57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:26.840431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:26.841590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-008501e8-b614-4215-9c77-1101ce99690c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:26.843540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 941/1870] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:26 2022] DELETE /identity/v3/projects/9910c800b9f14dd1befff3cba773d57c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:26.849045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:26.849544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:26.849853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:26.880113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:26.881756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:26.968760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 930/1871] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:26.978728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:26.979083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:26.979425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.011135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:27.012366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:27.022173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 942/1872] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:27.026741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.043679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154165c1-3367-4460-b63a-358aa6f28862 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.050203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.051287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.051287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.051700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.052470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:27.053018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.055357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.073332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 931/1873] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:27.080288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.087902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65132d0a-47f6-4e32-bdae-85644d106d20 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.092572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.093359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.093640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.093911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.094538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.096484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.140184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 943/1874] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:27 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:27.144868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.155312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3e9a-6334-4445-9323-dc22fa36fcde admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.185705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:27.270666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.271295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.271573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.271840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.272533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.277179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.305966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 932/1875] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:27 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:27.313255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.327376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40dcd2-72f6-4490-8c0e-4deb19fd2764 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.333156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.334260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.334412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.334835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.335634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.337855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.359539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 944/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:27.360294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.371770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698fd0a-bfde-45c7-96a1-fdcb8c2fa7ab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.377769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458b825-39fc-414d-991e-42b144d86952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.378153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458b825-39fc-414d-991e-42b144d86952 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.378346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458b825-39fc-414d-991e-42b144d86952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.378811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458b825-39fc-414d-991e-42b144d86952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.379551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458b825-39fc-414d-991e-42b144d86952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.386399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458b825-39fc-414d-991e-42b144d86952 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.401030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 933/1877] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:27.404290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.416265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87193072-195c-46c7-ba48-2e39eee83c34 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.432044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.432729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.433151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.433435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] PATH_INFO: `/v3/projects/3d49388b8509479bafd9906fbcd66d00/users/04a06237b31a4c26af811d019f9099c4/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.453527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d49388b8509479bafd9906fbcd66d00, user_id=04a06237b31a4c26af811d019f9099c4, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.453527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.475039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 945/1878] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:27 2022] PUT /identity/v3/projects/3d49388b8509479bafd9906fbcd66d00/users/04a06237b31a4c26af811d019f9099c4/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:27.488361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.488817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.489258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.530050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] MFA Rules not processed for user `04a06237b31a4c26af811d019f9099c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:27.531400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:27.616203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 934/1879] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:27.617533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.688830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.691065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:27.736175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2da05-d8ba-4b96-94a7-2aef08290dc7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.745133 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.746090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.746515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.746928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.748541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.750703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.789167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 946/1880] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:27 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:27.793598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.808796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3ce2-b900-4a40-b758-f3f18e560dfa None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.814603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:27.877485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:27.898283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895749-01b1-4667-964e-b340c1238e11 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.903176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.903843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.904121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.904458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] PATH_INFO: `/v3/users/ca78ee10f9c44df8a32c9870635515ba` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.904931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.905764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.905876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca78ee10f9c44df8a32c9870635515ba)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.906228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.906590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.907605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.908426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.909901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.946502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 947/1881] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:27 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:27.950711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:27.964425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d86e6-f877-4966-8713-b0bc9135c45c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:27.969769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:27.970415 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:27.970828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:27.971197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:27.972039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:27.973978 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:27.989654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 948/1882] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:27.990059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca78ee10f9c44df8a32c9870635515ba'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:27.994159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.016276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54b3c-3d8c-442d-8f87-f33c923b99ae admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.018897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca78ee10f9c44df8a32c9870635515ba'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.027650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.028529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.028638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca78ee10f9c44df8a32c9870635515ba'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.028802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.029391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca78ee10f9c44df8a32c9870635515ba'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.029696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] PATH_INFO: `/v3/projects/b14ab902b5e44ccb9261c1f43ca6a376/users/1a320dff71874a8ea4d33b6199d12055/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.030036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b39af5e2-4062-4c61-9f9e-97b468a706d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca78ee10f9c44df8a32c9870635515ba'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.049351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 935/1883] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:27 2022] DELETE /identity/v3/users/ca78ee10f9c44df8a32c9870635515ba => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:28.052548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ab902b5e44ccb9261c1f43ca6a376, user_id=1a320dff71874a8ea4d33b6199d12055, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.053965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.054250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.054605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.055357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.076960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 949/1884] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:27 2022] PUT /identity/v3/projects/b14ab902b5e44ccb9261c1f43ca6a376/users/1a320dff71874a8ea4d33b6199d12055/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:28.080201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:28.081545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.081745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.084660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.179789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 936/1885] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:28.180323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f042335-87b9-4cd0-8533-394687e352ff admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.180865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.182274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.185493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.186115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.186387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.186652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.187333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.188931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.200414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 950/1886] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:28.205250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.224330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0058b-4f5d-4886-8ebb-f18b81a59c71 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.230603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30524-ceab-4e91-8406-4c6a98b46945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.231539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30524-ceab-4e91-8406-4c6a98b46945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.231824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30524-ceab-4e91-8406-4c6a98b46945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.232390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30524-ceab-4e91-8406-4c6a98b46945 admin admin] PATH_INFO: `/v3/projects/b14ab902b5e44ccb9261c1f43ca6a376/users/1a320dff71874a8ea4d33b6199d12055/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.234599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d30524-ceab-4e91-8406-4c6a98b46945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ab902b5e44ccb9261c1f43ca6a376, user_id=1a320dff71874a8ea4d33b6199d12055, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.237959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d30524-ceab-4e91-8406-4c6a98b46945 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.248828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79c3c8-d4f0-49e8-8f96-d6a01a6af73f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.253100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 951/1887] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:28 2022] PUT /identity/v3/projects/b14ab902b5e44ccb9261c1f43ca6a376/users/1a320dff71874a8ea4d33b6199d12055/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:28.262094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.262377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.262650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.271099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:28.300335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] MFA Rules not processed for user `1a320dff71874a8ea4d33b6199d12055`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:28.302028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.342236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.342856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.343144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.343398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.346262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:28.384124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 952/1888] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:28.397205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.398794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.420445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.422327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.433947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 937/1889] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:28.478007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188e97-94d9-4518-9938-c19dbded7b0d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.502445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.503085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.503361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.503629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.539411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.539411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.567332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 953/1890] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:28.610909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.612389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.625580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2deae-c835-4875-923a-a39bf9d90987 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.632431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.632431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.632431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.632431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.633780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.716858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.719460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.741566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 938/1891] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:28.816614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.818915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:28.840734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a0b1-9fff-448a-a863-cab77e0fd92f service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:28.860323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:28.861001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:28.861935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:28.862265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] PATH_INFO: `/v3/projects/d892d6cd9e1944ea856c0b49b8eedb7e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:28.863488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d892d6cd9e1944ea856c0b49b8eedb7e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:28.866074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:28.920086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd892d6cd9e1944ea856c0b49b8eedb7e', 'request_id': 'req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.931131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd892d6cd9e1944ea856c0b49b8eedb7e', 'request_id': 'req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.942194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd892d6cd9e1944ea856c0b49b8eedb7e', 'request_id': 'req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.953508 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] The token cache is being invalidate because project d892d6cd9e1944ea856c0b49b8eedb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:28.953861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.954556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:28.956410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 954/1892] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:28 2022] DELETE /identity/v3/projects/d892d6cd9e1944ea856c0b49b8eedb7e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:28.960651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:28.980136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e32551-3256-44df-884e-795ed13447cc service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:29.068867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:29.069577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:29.070813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:29.071160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] PATH_INFO: `/v3/users/dad855cf0b8845bfad4103c8ad953ffd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:29.072508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad855cf0b8845bfad4103c8ad953ffd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:29.075154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:29.081844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:29.167594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad855cf0b8845bfad4103c8ad953ffd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.186286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad855cf0b8845bfad4103c8ad953ffd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.198643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad855cf0b8845bfad4103c8ad953ffd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.199519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad855cf0b8845bfad4103c8ad953ffd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.200499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad855cf0b8845bfad4103c8ad953ffd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.230348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 939/1893] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:28 2022] DELETE /identity/v3/users/dad855cf0b8845bfad4103c8ad953ffd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:29.697808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:29.699365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:29.715085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592462-b2ac-49ab-9c16-3cf8499c2ed9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:29.785080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:29.785743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:29.786039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:29.786309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] PATH_INFO: `/v3/projects/083c2011762346f3b27dc4b5138e4c64` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:29.787588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=083c2011762346f3b27dc4b5138e4c64)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:29.789623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:29.792152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:29.854223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083c2011762346f3b27dc4b5138e4c64', 'request_id': 'req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.864185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083c2011762346f3b27dc4b5138e4c64', 'request_id': 'req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.877602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083c2011762346f3b27dc4b5138e4c64', 'request_id': 'req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.889295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] The token cache is being invalidate because project 083c2011762346f3b27dc4b5138e4c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:29.889571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.890323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:29.895765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 955/1894] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:29 2022] DELETE /identity/v3/projects/083c2011762346f3b27dc4b5138e4c64 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:29.897149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:29.898980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:29.916195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc974-b8b4-49f1-a873-936f9227b751 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:29.980093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:29.980766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:29.981029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:29.981371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] PATH_INFO: `/v3/users/24cbd5ce82b1406fbee1b665987288f7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:29.982478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24cbd5ce82b1406fbee1b665987288f7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:29.984457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:30.044581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24cbd5ce82b1406fbee1b665987288f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.062233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24cbd5ce82b1406fbee1b665987288f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.069403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24cbd5ce82b1406fbee1b665987288f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.070135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24cbd5ce82b1406fbee1b665987288f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.070737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-379b2ab6-bead-4677-bd69-dc5de837df5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24cbd5ce82b1406fbee1b665987288f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.085294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 940/1895] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:29 2022] DELETE /identity/v3/users/24cbd5ce82b1406fbee1b665987288f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:30.470939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:30.473977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:30.497808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923597-a243-4cf7-b6ff-6f1a6b448a4e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:30.660628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:30.661316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:30.661594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:30.661860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] PATH_INFO: `/v3/projects/300b6227886842b88a49244e923fd78a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:30.666903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] RBAC: Authorizing `identity:delete_project(project_id=300b6227886842b88a49244e923fd78a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:30.669308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:30.771040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300b6227886842b88a49244e923fd78a', 'request_id': 'req-85554b03-14ee-490c-b6d3-4809637909da'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.778345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300b6227886842b88a49244e923fd78a', 'request_id': 'req-85554b03-14ee-490c-b6d3-4809637909da'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.790693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300b6227886842b88a49244e923fd78a', 'request_id': 'req-85554b03-14ee-490c-b6d3-4809637909da'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.805678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] The token cache is being invalidate because project 300b6227886842b88a49244e923fd78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:30.805966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.809053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-85554b03-14ee-490c-b6d3-4809637909da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:30.809053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 956/1896] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:30 2022] DELETE /identity/v3/projects/300b6227886842b88a49244e923fd78a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:30.818594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:30.818841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:30.819233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:30.830664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:30.852041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:30.853352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:30.973470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 941/1897] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:30.982048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:30.982512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:30.982902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.014471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:31.016081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:31.031393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 957/1898] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:31.035929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.046529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed28846-8c13-4091-a90c-d8d92c98ce9a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.051268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.051955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.052292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.053296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.054038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:31.054407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.056165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.073157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 942/1899] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:31.075062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.085239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42fad0-4dde-4d36-9fff-f595e17a748a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.090522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.091139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.091570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.091951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.092585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.094591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.116017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:31.144188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 958/1900] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:31 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:31.145644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.157679 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82e3df-9f5e-45db-b7ad-e9cdc584671a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.259556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.260176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.260448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.260711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.261916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.263298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.290121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 943/1901] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:31 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:31.294198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.305001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721963dc-574e-4850-85ab-72a94f1add74 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.310689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.311362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.311633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.311895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.312537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.314231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.329058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 959/1902] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:31.340441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.353307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fccc61-345d-4fdb-960a-2cdabc4cfad4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.358320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b9b66-b7cc-419e-ab11-c5fe26da0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.358937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9b66-b7cc-419e-ab11-c5fe26da0f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.359210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9b66-b7cc-419e-ab11-c5fe26da0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.359480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9b66-b7cc-419e-ab11-c5fe26da0f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.360123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b9b66-b7cc-419e-ab11-c5fe26da0f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.362080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b9b66-b7cc-419e-ab11-c5fe26da0f9b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.377324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 944/1903] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:31.378249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.388832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65fb33-0612-4579-9481-881b802eeed7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.393621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.394370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.394736 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.395060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] PATH_INFO: `/v3/projects/3e0dac9844204742881ff2f8a4b57a2f/users/7be60af968f24e7987645e8e34071813/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.413615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0dac9844204742881ff2f8a4b57a2f, user_id=7be60af968f24e7987645e8e34071813, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.416460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.441531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 960/1904] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:31 2022] PUT /identity/v3/projects/3e0dac9844204742881ff2f8a4b57a2f/users/7be60af968f24e7987645e8e34071813/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:31.456064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.456491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.458079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.501321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] MFA Rules not processed for user `7be60af968f24e7987645e8e34071813`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:31.502574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:31.564029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:31.570650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 945/1905] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:31.582970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:31.584967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:31.642092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf31d9-da3d-4fad-b190-489806e918d8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:31.645899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f06b6-95b6-42c7-92cf-46d60d7ca233 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:31.646573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f06b6-95b6-42c7-92cf-46d60d7ca233 service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:31.646916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f06b6-95b6-42c7-92cf-46d60d7ca233 service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:31.647246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f06b6-95b6-42c7-92cf-46d60d7ca233 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:31.655533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f06b6-95b6-42c7-92cf-46d60d7ca233 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:31.656961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f06b6-95b6-42c7-92cf-46d60d7ca233 service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:31.666607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 961/1906] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:32.757776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:32.759259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:32.881023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad1fe-38a1-42bb-a3bd-0ae4be5c34de None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:32.892285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:32.893329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:32.893705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:32.894123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] PATH_INFO: `/v3/users/04a06237b31a4c26af811d019f9099c4` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:32.895416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a06237b31a4c26af811d019f9099c4)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:32.897640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:32.958372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a06237b31a4c26af811d019f9099c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:32.973289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a06237b31a4c26af811d019f9099c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:32.982753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a06237b31a4c26af811d019f9099c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:32.983506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a06237b31a4c26af811d019f9099c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:32.984117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a06237b31a4c26af811d019f9099c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:33.006139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 946/1907] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:32 2022] DELETE /identity/v3/users/04a06237b31a4c26af811d019f9099c4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:33.008180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:33.008634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:33.008730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:33.029671 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:33.030893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:33.111823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 962/1908] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:33.122464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:33.124564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:33.216392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e8e8-0efe-411d-8a7a-0968ab761767 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:33.224180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:33.224830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:33.225227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:33.225491 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:33.250323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:33.261100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:33.276271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 947/1909] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:34.373764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:34.375340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:34.398751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741671c-eace-4722-924c-a6842db2cb5b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:34.406068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:34.406724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:34.407000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:34.407334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] PATH_INFO: `/v3/projects/3d49388b8509479bafd9906fbcd66d00` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:34.408915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d49388b8509479bafd9906fbcd66d00)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:34.411847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:34.492592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d49388b8509479bafd9906fbcd66d00', 'request_id': 'req-c450ad0f-d5e2-4985-bc70-526f9ad28706'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.500592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d49388b8509479bafd9906fbcd66d00', 'request_id': 'req-c450ad0f-d5e2-4985-bc70-526f9ad28706'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.504025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:34.517493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d49388b8509479bafd9906fbcd66d00', 'request_id': 'req-c450ad0f-d5e2-4985-bc70-526f9ad28706'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.535788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] The token cache is being invalidate because project 3d49388b8509479bafd9906fbcd66d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:34.536286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.537393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.543156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 963/1910] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:34 2022] DELETE /identity/v3/projects/3d49388b8509479bafd9906fbcd66d00 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:34.544023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:34.555270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7966ab-86b7-4d65-9a12-2ae7ce5b2270 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:34.586177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:34.650118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:34.650970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:34.651345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:34.651722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] PATH_INFO: `/v3/users/1a320dff71874a8ea4d33b6199d12055` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:34.653473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a320dff71874a8ea4d33b6199d12055)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:34.655689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:34.739001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a320dff71874a8ea4d33b6199d12055'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.762847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a320dff71874a8ea4d33b6199d12055'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.775791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a320dff71874a8ea4d33b6199d12055'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.776582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a320dff71874a8ea4d33b6199d12055'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.777170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d7781f6c-18f3-4592-a451-c941c530fdad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a320dff71874a8ea4d33b6199d12055'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:34.793676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 948/1911] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:34 2022] DELETE /identity/v3/users/1a320dff71874a8ea4d33b6199d12055 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:35.094135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.095772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:35.109287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ad0f-d5e2-4985-bc70-526f9ad28706 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.212541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.213221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.213492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.213915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] PATH_INFO: `/v3/projects/b14ab902b5e44ccb9261c1f43ca6a376` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.215035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14ab902b5e44ccb9261c1f43ca6a376)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.217032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.295639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14ab902b5e44ccb9261c1f43ca6a376', 'request_id': 'req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:35.304155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14ab902b5e44ccb9261c1f43ca6a376', 'request_id': 'req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:35.314914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14ab902b5e44ccb9261c1f43ca6a376', 'request_id': 'req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:35.334782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] The token cache is being invalidate because project b14ab902b5e44ccb9261c1f43ca6a376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:35.335209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:35.335962 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6e3df5f3-457e-4ca0-a694-e04e26fdd1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:35.337937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 964/1912] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:35 2022] DELETE /identity/v3/projects/b14ab902b5e44ccb9261c1f43ca6a376 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:35.342755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.343035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.343302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.370947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:35.372594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:35.469286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 949/1913] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:35.470986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.471479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.471555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.493959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:35.495254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:35.503691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 965/1914] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:35.508092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.521642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80a78-5411-420d-a722-4c791f8fe83a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.531314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.531314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.531754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.531910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.532581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:35.533222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.535080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.550428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 950/1915] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:35.555468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.567599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226fec-591d-43fd-a7e5-af94a10afd10 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.577931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.580272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.581299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.581578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.582237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.585709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.626902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 966/1916] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:35 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:35.631264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.644372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ff50-1e53-469c-8a69-89cbcf43a146 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.679997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:35.725326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.726047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.726410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.726742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.728071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.730129 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.755061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 951/1917] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:35 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:35.756597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.767945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab623f-3897-4589-81b0-9fe72df73636 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.773042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.773765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.774105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.774459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.775167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.776869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.791716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 967/1918] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:35.795828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.807156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7071-4f32-41db-8b0d-f87246046e78 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.811921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4331a4-6c35-47e3-a93f-368a61790b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.812560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4331a4-6c35-47e3-a93f-368a61790b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.812813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4331a4-6c35-47e3-a93f-368a61790b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.813114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4331a4-6c35-47e3-a93f-368a61790b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.814175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4331a4-6c35-47e3-a93f-368a61790b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.815934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4331a4-6c35-47e3-a93f-368a61790b14 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.829290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 952/1919] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:35.843735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:35.855478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311628d-82e3-47cf-8756-2a92398c3d60 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:35.863112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:35.863815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.864176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.865588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] PATH_INFO: `/v3/projects/a1f99822a97b4b8fbf087fbcb04f6215/users/dddff5ce0de54bd78f36cd2c0bf6944f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.883873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f99822a97b4b8fbf087fbcb04f6215, user_id=dddff5ce0de54bd78f36cd2c0bf6944f, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:35.887669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:35.908597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 968/1920] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:35 2022] PUT /identity/v3/projects/a1f99822a97b4b8fbf087fbcb04f6215/users/dddff5ce0de54bd78f36cd2c0bf6944f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:35.919409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:35.919839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:35.920192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:35.950007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] MFA Rules not processed for user `dddff5ce0de54bd78f36cd2c0bf6944f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:35.951412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:36.023151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 953/1921] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:36.027556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:36.061463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:36.204162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121a55-e9fa-475e-af51-5ae769e92e4c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:36.210932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:36.211874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.212160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.212371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.213163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:36.215589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:36.264698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 969/1922] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:36 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:36.270289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:36.289330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df06ec4-b2e6-4fc3-a554-dc7680a688ed None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:36.446369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:36.447077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.447361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.447649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.448281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:36.450245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:36.515916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 954/1923] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:36 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:36.519989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:36.532232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b7e4-5390-4eab-ba65-054b4e54d2f7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:36.538628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:36.539488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.540435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.541022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.541817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:36.544047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:36.574980 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 970/1924] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:36.576811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:36.594081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2703f4c-4051-41cc-9456-ae52be136080 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:36.602214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:36.603461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.607014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.607808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] PATH_INFO: `/v3/projects/e796611b6b2f4224ae3e4aff5ac9b66c/users/23dbcb6c68e24bfdb530f367a77c9c32/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.630065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e796611b6b2f4224ae3e4aff5ac9b66c, user_id=23dbcb6c68e24bfdb530f367a77c9c32, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:36.634343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:36.649374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:36.666962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 955/1925] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:36 2022] PUT /identity/v3/projects/e796611b6b2f4224ae3e4aff5ac9b66c/users/23dbcb6c68e24bfdb530f367a77c9c32/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:36.671217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:36.693898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b49b8b-b721-49c2-915a-10bf8e918f94 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:36.785048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee251e-4dc0-4c8f-967d-824243d5321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:36.785796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee251e-4dc0-4c8f-967d-824243d5321a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.785998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee251e-4dc0-4c8f-967d-824243d5321a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.786274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee251e-4dc0-4c8f-967d-824243d5321a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.789896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee251e-4dc0-4c8f-967d-824243d5321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:36.791706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee251e-4dc0-4c8f-967d-824243d5321a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:36.804305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 971/1926] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:36.808647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:36.822393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce95cb-c711-4ea8-866a-8515339a4b8e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:36.829923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:36.830851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.831322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.832378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] PATH_INFO: `/v3/projects/e796611b6b2f4224ae3e4aff5ac9b66c/users/23dbcb6c68e24bfdb530f367a77c9c32/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.835958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e796611b6b2f4224ae3e4aff5ac9b66c, user_id=23dbcb6c68e24bfdb530f367a77c9c32, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:36.841813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:36.861916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 956/1927] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:36 2022] PUT /identity/v3/projects/e796611b6b2f4224ae3e4aff5ac9b66c/users/23dbcb6c68e24bfdb530f367a77c9c32/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:36.874211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:36.874490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:36.875016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:36.920640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] MFA Rules not processed for user `23dbcb6c68e24bfdb530f367a77c9c32`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:36.922039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:37.002027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 972/1928] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:37.014302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:37.016099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:37.095648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6aabe-6b62-4d8c-8564-889a1736145f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:37.100895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ca302-cf58-4b6e-94e0-89d2136e2747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:37.101558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca302-cf58-4b6e-94e0-89d2136e2747 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:37.101828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca302-cf58-4b6e-94e0-89d2136e2747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:37.102303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca302-cf58-4b6e-94e0-89d2136e2747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:37.122222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ca302-cf58-4b6e-94e0-89d2136e2747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:37.129006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ca302-cf58-4b6e-94e0-89d2136e2747 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:37.142449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 957/1929] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:37.219591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:37.246113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:37.325537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf9225-fddf-403f-80aa-143337ac4c17 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:37.330073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:37.330990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:37.331263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:37.331529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] PATH_INFO: `/v3/users/dddff5ce0de54bd78f36cd2c0bf6944f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:37.332754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddff5ce0de54bd78f36cd2c0bf6944f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:37.334784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:37.403016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddff5ce0de54bd78f36cd2c0bf6944f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.416574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddff5ce0de54bd78f36cd2c0bf6944f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.436433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddff5ce0de54bd78f36cd2c0bf6944f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.437179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddff5ce0de54bd78f36cd2c0bf6944f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.437806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddff5ce0de54bd78f36cd2c0bf6944f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.458443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 973/1930] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:37 2022] DELETE /identity/v3/users/dddff5ce0de54bd78f36cd2c0bf6944f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:37.460286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:37.460566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:37.460835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:37.481703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:37.482990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:37.551082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 958/1931] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:37.560964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:37.562373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:37.619533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8315e-a542-46ae-8f1c-a4fa7ff1565c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:37.623660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a9655-5c63-4f60-a7a5-b0ca16d6cb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:37.624263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9655-5c63-4f60-a7a5-b0ca16d6cb98 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:37.624524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9655-5c63-4f60-a7a5-b0ca16d6cb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:37.624780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9655-5c63-4f60-a7a5-b0ca16d6cb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:37.634977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a9655-5c63-4f60-a7a5-b0ca16d6cb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:37.636655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a9655-5c63-4f60-a7a5-b0ca16d6cb98 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:37.647251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 974/1932] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:37.720778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:37.722846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:37.736452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cebb1b-18ff-4e06-af6d-81bfef70beb6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:37.748638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:37.749615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:37.750040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:37.750185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] PATH_INFO: `/v3/users/b6f42fd560f0426ca408e2b9f2320710` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:37.751710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f42fd560f0426ca408e2b9f2320710)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:37.754751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:37.808015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f42fd560f0426ca408e2b9f2320710'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.825726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f42fd560f0426ca408e2b9f2320710'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.836715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f42fd560f0426ca408e2b9f2320710'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.837497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f42fd560f0426ca408e2b9f2320710'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.838092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f42fd560f0426ca408e2b9f2320710'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:37.861265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 959/1933] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:37 2022] DELETE /identity/v3/users/b6f42fd560f0426ca408e2b9f2320710 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:37.865891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:37.866173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:37.866452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:37.905487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:37.916903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:37.954333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:38.003088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 975/1934] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:38.014975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:38.015996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:38.021798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:38.065129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:38.066968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:38.093180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750f9cd-9eb6-4d3b-a416-69feb3c260dd None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:38.099032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:38.100140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.100607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.100735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] PATH_INFO: `/v3/projects/a1f99822a97b4b8fbf087fbcb04f6215` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.101586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a921819-24cd-42ff-a72d-cae364317ad8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:38.102307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f99822a97b4b8fbf087fbcb04f6215)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:38.104349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:38.110355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:38.117821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.119091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.119447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.136021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:38.140077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:38.160522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 960/1935] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:38.169243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f99822a97b4b8fbf087fbcb04f6215', 'request_id': 'req-4b521c8f-c837-47a9-9008-ab56a4baf825'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.175384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f99822a97b4b8fbf087fbcb04f6215', 'request_id': 'req-4b521c8f-c837-47a9-9008-ab56a4baf825'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.184116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f99822a97b4b8fbf087fbcb04f6215', 'request_id': 'req-4b521c8f-c837-47a9-9008-ab56a4baf825'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.198809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] The token cache is being invalidate because project a1f99822a97b4b8fbf087fbcb04f6215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:38.199317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.199979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.201882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 976/1936] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:38 2022] DELETE /identity/v3/projects/a1f99822a97b4b8fbf087fbcb04f6215 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:38.206088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:38.216084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225e98-5890-415c-b970-9a817c0e50f5 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:38.276314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:38.276943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.277292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.277513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] PATH_INFO: `/v3/users/23dbcb6c68e24bfdb530f367a77c9c32` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.278645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23dbcb6c68e24bfdb530f367a77c9c32)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:38.280548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:38.345625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23dbcb6c68e24bfdb530f367a77c9c32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.365418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23dbcb6c68e24bfdb530f367a77c9c32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.375222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23dbcb6c68e24bfdb530f367a77c9c32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.375799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23dbcb6c68e24bfdb530f367a77c9c32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.376476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44e24f8a-5f89-4cd6-9a5d-fd4ac9e15142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23dbcb6c68e24bfdb530f367a77c9c32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.398823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 961/1937] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:38 2022] DELETE /identity/v3/users/23dbcb6c68e24bfdb530f367a77c9c32 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:38.524674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:38.526238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:38.576931 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521c8f-c837-47a9-9008-ab56a4baf825 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:38.686203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:38.687160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.687526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.687913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] PATH_INFO: `/v3/projects/11d41e9ecbb64d8c851053718a72a5c5` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.689212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d41e9ecbb64d8c851053718a72a5c5)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:38.691698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:38.755298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d41e9ecbb64d8c851053718a72a5c5', 'request_id': 'req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.763077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d41e9ecbb64d8c851053718a72a5c5', 'request_id': 'req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.769574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:38.779067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d41e9ecbb64d8c851053718a72a5c5', 'request_id': 'req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.792143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] The token cache is being invalidate because project 11d41e9ecbb64d8c851053718a72a5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:38.792456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.795376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.799461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 977/1938] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:38 2022] DELETE /identity/v3/projects/11d41e9ecbb64d8c851053718a72a5c5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:38.799605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:38.799780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695514b3-26d9-40aa-96fa-42e3fdbd9afd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.800211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695514b3-26d9-40aa-96fa-42e3fdbd9afd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.800304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695514b3-26d9-40aa-96fa-42e3fdbd9afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.800917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:38.829145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-695514b3-26d9-40aa-96fa-42e3fdbd9afd None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:38.830453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-695514b3-26d9-40aa-96fa-42e3fdbd9afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:38.856635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:38.885964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28dec-cc5a-4ad7-8c12-0c7df0b6245c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:38.894130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:38.894872 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.895154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.895437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] PATH_INFO: `/v3/projects/e796611b6b2f4224ae3e4aff5ac9b66c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.896807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e796611b6b2f4224ae3e4aff5ac9b66c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:38.900306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:38.925462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 962/1939] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:38.934023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:38.934376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:38.934709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:38.958086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:38.961849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:38.969721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e796611b6b2f4224ae3e4aff5ac9b66c', 'request_id': 'req-6ffa5222-558a-4588-9688-5d33abfe9232'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.976947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e796611b6b2f4224ae3e4aff5ac9b66c', 'request_id': 'req-6ffa5222-558a-4588-9688-5d33abfe9232'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:38.987081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e796611b6b2f4224ae3e4aff5ac9b66c', 'request_id': 'req-6ffa5222-558a-4588-9688-5d33abfe9232'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:39.000764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] The token cache is being invalidate because project e796611b6b2f4224ae3e4aff5ac9b66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:39.001096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:39.001779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ffa5222-558a-4588-9688-5d33abfe9232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:39.003456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 978/1940] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:38 2022] DELETE /identity/v3/projects/e796611b6b2f4224ae3e4aff5ac9b66c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:39.008606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec97ed-bacd-4467-8aa6-3bf98d124ac3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.009049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec97ed-bacd-4467-8aa6-3bf98d124ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.009476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec97ed-bacd-4467-8aa6-3bf98d124ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.031348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5aec97ed-bacd-4467-8aa6-3bf98d124ac3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:39.032699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5aec97ed-bacd-4467-8aa6-3bf98d124ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:39.035838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 963/1941] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:39.036780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.049193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e008d-07c9-412d-87bc-b76e48de584f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.051383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 979/1942] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:39.053076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.053360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.054292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.057770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.058577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.058856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.059120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.060058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:39.060372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.062059 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.078211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:39.078344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 964/1943] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:11:39.079236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.079702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:39.089538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 980/1944] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:39.089902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e32b-ee7c-43ea-84c7-530ece25b0c2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.093906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.095488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.096460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.096460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.096641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.099735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.099735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.108629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62b8b6-75fe-451c-879c-8326c5d1c044 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.132248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.133221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.133419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.133841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.134759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:39.135320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.137735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.150766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 965/1945] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:39.154964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.158749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 981/1946] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:11:39.165283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.175643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70b79-7a51-439f-a89f-9fa60aa63f08 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.221795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219609b-2d36-41d2-b6b7-d5a1767d5dee admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.228029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.228350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:39.228578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.228908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.229208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.229838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.232241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.244556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.245260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.245606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.246005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.246824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.249359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.258035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 966/1947] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:39.260756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.270231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde512be-1658-41de-a5c4-0a48ff169dea admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.274868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.275463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.275723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.275986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.276614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.278227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.284695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 982/1948] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:39.285915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.291324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 967/1949] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:39.292536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.302895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e2a04-2318-4556-be80-b19b35f93dbe admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.308093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:39.350916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b31d-02f2-46f1-a263-ea53963f5716 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.356700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.357402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.357681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.357969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.358669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.360669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.365419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.366084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.366357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.366620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.367276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.369426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.379619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 968/1950] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:39.386153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 983/1951] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:39.386317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.387144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.393285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1598892-dad4-4c4d-ad2f-65c3f20e223e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.397197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362e468-4cfd-43a3-873b-be69ac8c7f25 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.398864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a5b72-c692-4451-8e02-4bb483a4358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.399876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a5b72-c692-4451-8e02-4bb483a4358b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.400356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a5b72-c692-4451-8e02-4bb483a4358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.400651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a5b72-c692-4451-8e02-4bb483a4358b admin admin] PATH_INFO: `/v3/projects/a5f2f771527844fd85880590f19d0408/users/050ac15b06e84a6d831c871b8de346aa/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.402252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.402857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.403132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.403390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.404034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.405966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.416347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a5b72-c692-4451-8e02-4bb483a4358b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f2f771527844fd85880590f19d0408, user_id=050ac15b06e84a6d831c871b8de346aa, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.420796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 984/1952] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:39.420924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a5b72-c692-4451-8e02-4bb483a4358b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.421799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.435153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 969/1953] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:39 2022] PUT /identity/v3/projects/a5f2f771527844fd85880590f19d0408/users/050ac15b06e84a6d831c871b8de346aa/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:39.435486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f281-55d2-4d5a-aabc-221612436c12 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.448003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.448550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.449031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.482483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] MFA Rules not processed for user `050ac15b06e84a6d831c871b8de346aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:39.483751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:39.508838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.509484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.509754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.510021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.510655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.512288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.522471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 985/1954] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:39.526663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.536013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7c55a-c07a-4a3f-b0bc-725135471782 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.540499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab00c3-c8f6-46d8-a036-9a7ab6b7cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.541168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab00c3-c8f6-46d8-a036-9a7ab6b7cfe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.541442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab00c3-c8f6-46d8-a036-9a7ab6b7cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.541706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab00c3-c8f6-46d8-a036-9a7ab6b7cfe9 admin admin] PATH_INFO: `/v3/projects/247b62838a0f49b599c216cc20fbca61/users/4631d6a4afcb4757a39902b83ee61f7e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.555490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 970/1955] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:39.560801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab00c3-c8f6-46d8-a036-9a7ab6b7cfe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247b62838a0f49b599c216cc20fbca61, user_id=4631d6a4afcb4757a39902b83ee61f7e, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.563553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab00c3-c8f6-46d8-a036-9a7ab6b7cfe9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.566789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.568445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:39.578445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 986/1956] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:39 2022] PUT /identity/v3/projects/247b62838a0f49b599c216cc20fbca61/users/4631d6a4afcb4757a39902b83ee61f7e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:39.592173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.592440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.592731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.621095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] MFA Rules not processed for user `4631d6a4afcb4757a39902b83ee61f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:39.622282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:39.627686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec36156-9d56-4a12-801a-1f3354f95868 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.631300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:39.657394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:39.685423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.686044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.686776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.687114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.701115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 987/1957] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:39.705527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.751429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.752840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.761995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 971/1958] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:39.770071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf4f7-03d2-4131-8303-f8f61d63e662 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.774661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.775272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.775541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.775800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.776416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.778370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.809017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 988/1959] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:39.814030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.826388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f11e9-b1f8-48e1-bc82-5721cf88bf58 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.886525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.887145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.887419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.887686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.888314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.890269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.918237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 972/1960] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:39 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:39.919477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.929869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b5b9-1472-4fd9-a4cb-ed8d716094ac admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.935090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.935907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.936238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.936579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.937331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.939164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:39.954570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 989/1961] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:39.956176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:39.966753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9caa7f-533c-409b-bf60-502fa087f563 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:39.971938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:39.972587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:39.972858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:39.973165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] PATH_INFO: `/v3/projects/7ca23d790bcf4799aa71fc4d2aa52c88/users/2d94d6b6756545d3b153bc93ed04bf9e/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:39.989486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca23d790bcf4799aa71fc4d2aa52c88, user_id=2d94d6b6756545d3b153bc93ed04bf9e, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:39.992105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:40.008416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 973/1962] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:39 2022] PUT /identity/v3/projects/7ca23d790bcf4799aa71fc4d2aa52c88/users/2d94d6b6756545d3b153bc93ed04bf9e/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:40.012899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:40.027280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c436-4df7-40ba-97b6-47620c671ffe admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:40.097819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeacda-ebe8-465c-808c-404bfce59c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:40.098457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeacda-ebe8-465c-808c-404bfce59c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.098768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeacda-ebe8-465c-808c-404bfce59c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.099113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeacda-ebe8-465c-808c-404bfce59c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.099895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeacda-ebe8-465c-808c-404bfce59c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:40.101743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeacda-ebe8-465c-808c-404bfce59c83 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:40.117666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 990/1963] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:40.119053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:40.134787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825222f-5eb5-4482-8969-35fe4d148249 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:40.139757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:40.140720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.141160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.141462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] PATH_INFO: `/v3/projects/7ca23d790bcf4799aa71fc4d2aa52c88/users/2d94d6b6756545d3b153bc93ed04bf9e/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.144450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca23d790bcf4799aa71fc4d2aa52c88, user_id=2d94d6b6756545d3b153bc93ed04bf9e, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:40.147229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:40.160466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 974/1964] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:40 2022] PUT /identity/v3/projects/7ca23d790bcf4799aa71fc4d2aa52c88/users/2d94d6b6756545d3b153bc93ed04bf9e/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:40.174780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.175105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.175346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.217834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] MFA Rules not processed for user `2d94d6b6756545d3b153bc93ed04bf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:40.219028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:40.229287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:40.296615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 991/1965] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:40.317238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:40.353225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:40.377684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc925-640b-48a9-b57e-82a5dac2395c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:40.381914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0983-9728-4ac4-b06c-68b8ed7c3d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:40.382526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0983-9728-4ac4-b06c-68b8ed7c3d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.382798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0983-9728-4ac4-b06c-68b8ed7c3d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.383060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0983-9728-4ac4-b06c-68b8ed7c3d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.393447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0983-9728-4ac4-b06c-68b8ed7c3d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:40.394878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0983-9728-4ac4-b06c-68b8ed7c3d1e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:40.404271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 975/1966] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:40.553215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:40.617212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce32f3-b2f9-48f8-9a2d-9dd932b3d228 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:40.623035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:40.623846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.624231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.624499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] PATH_INFO: `/v3/users/4631d6a4afcb4757a39902b83ee61f7e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.625716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4631d6a4afcb4757a39902b83ee61f7e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:40.627707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:40.676751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4631d6a4afcb4757a39902b83ee61f7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:40.684593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4631d6a4afcb4757a39902b83ee61f7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:40.699287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4631d6a4afcb4757a39902b83ee61f7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:40.701379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4631d6a4afcb4757a39902b83ee61f7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:40.702407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4631d6a4afcb4757a39902b83ee61f7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:40.715388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 992/1967] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:40 2022] DELETE /identity/v3/users/4631d6a4afcb4757a39902b83ee61f7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:40.720041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.720371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.720645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.740835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:40.742111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:40.804046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 976/1968] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:40.815373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:40.817259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:40.849207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:40.880972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d6fd-52c7-4164-8fb8-94296d1f11b2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:40.884903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:40.885534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:40.885802 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:40.886059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:40.895159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:40.896583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:40.906054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 993/1969] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:41.193650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:41.195138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:41.211669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e42b2-0635-4ccf-9850-e81bcc2b9b9e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:41.218085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:41.218960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:41.219238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:41.219560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] PATH_INFO: `/v3/projects/247b62838a0f49b599c216cc20fbca61` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:41.221173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=247b62838a0f49b599c216cc20fbca61)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:41.223604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:41.277191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247b62838a0f49b599c216cc20fbca61', 'request_id': 'req-0de87619-ae3d-4291-908a-909c5061db0e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.288336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247b62838a0f49b599c216cc20fbca61', 'request_id': 'req-0de87619-ae3d-4291-908a-909c5061db0e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.296143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247b62838a0f49b599c216cc20fbca61', 'request_id': 'req-0de87619-ae3d-4291-908a-909c5061db0e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.308901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] The token cache is being invalidate because project 247b62838a0f49b599c216cc20fbca61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:41.309098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.309764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.312480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 977/1970] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:41 2022] DELETE /identity/v3/projects/247b62838a0f49b599c216cc20fbca61 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:41.315580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:41.330797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80f517-73e2-4e37-a128-7b01a4c6a289 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:41.414060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:41.414665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:41.414939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:41.415281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] PATH_INFO: `/v3/users/2d94d6b6756545d3b153bc93ed04bf9e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:41.416470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d94d6b6756545d3b153bc93ed04bf9e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:41.418525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:41.478370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d94d6b6756545d3b153bc93ed04bf9e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.486979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d94d6b6756545d3b153bc93ed04bf9e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.502582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d94d6b6756545d3b153bc93ed04bf9e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.503506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d94d6b6756545d3b153bc93ed04bf9e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.504110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0be34ddb-594d-4c49-9e68-66e635cf7be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d94d6b6756545d3b153bc93ed04bf9e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:41.519697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 994/1971] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:41 2022] DELETE /identity/v3/users/2d94d6b6756545d3b153bc93ed04bf9e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:41.831608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:41.833275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:41.851823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87619-ae3d-4291-908a-909c5061db0e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:41.924053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:41.924730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:41.925025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:41.925297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] PATH_INFO: `/v3/projects/7ca23d790bcf4799aa71fc4d2aa52c88` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:41.926429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca23d790bcf4799aa71fc4d2aa52c88)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:41.928355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:41.930409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:42.005605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca23d790bcf4799aa71fc4d2aa52c88', 'request_id': 'req-e3c1cbf5-d37a-462e-9998-1ac702a48c61'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:42.015502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca23d790bcf4799aa71fc4d2aa52c88', 'request_id': 'req-e3c1cbf5-d37a-462e-9998-1ac702a48c61'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:42.023828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca23d790bcf4799aa71fc4d2aa52c88', 'request_id': 'req-e3c1cbf5-d37a-462e-9998-1ac702a48c61'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:42.036385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] The token cache is being invalidate because project 7ca23d790bcf4799aa71fc4d2aa52c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:42.036960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:42.037891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e3c1cbf5-d37a-462e-9998-1ac702a48c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:42.045064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 978/1972] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:41 2022] DELETE /identity/v3/projects/7ca23d790bcf4799aa71fc4d2aa52c88 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:42.050241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.050772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.050772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.072328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:42.073647 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:42.132488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:42.151298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 995/1973] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:42.158813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.159086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.159356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.180034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:42.181195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:42.192332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 979/1974] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:42.193603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.203497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e332-5400-412f-b223-62e84f7eebc2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.208107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.208709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.209005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.209283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.209960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:42.210258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.211869 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.223562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 996/1975] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:42.228057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.239022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfdd51-f0ff-4bdd-9950-440953de38b0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.245247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.245863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.246127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.246403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.247021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.249023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.280185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 980/1976] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:42.284823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.295326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2c8ad-7817-492f-b1cc-9bbb0bf96386 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.352324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.352948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.353263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.353546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.354218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.356163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.382852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 997/1977] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:42.386939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.405118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cea7b-ff13-412c-bcbe-3ee847eec45f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.410351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.410976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.411241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.411503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.412270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.413915 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.424824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 981/1978] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:42.429214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.440445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daac080-edfe-49c7-bd05-96d029f23ca2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.445987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e9064-e8bb-403e-8b9d-9ee566d26cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.446609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e9064-e8bb-403e-8b9d-9ee566d26cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.446891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e9064-e8bb-403e-8b9d-9ee566d26cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.447161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e9064-e8bb-403e-8b9d-9ee566d26cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.447815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e9064-e8bb-403e-8b9d-9ee566d26cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.449483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e9064-e8bb-403e-8b9d-9ee566d26cd6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.462429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 998/1979] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:42.467287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.478354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105506-8aff-4d82-a450-3cbc2f7690c3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.483280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.484087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.484587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.484929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] PATH_INFO: `/v3/projects/91be497301804bc9b4a76b4af5b0763e/users/1bab3343b85645998e84839150743f4f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.501785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91be497301804bc9b4a76b4af5b0763e, user_id=1bab3343b85645998e84839150743f4f, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.504629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.520889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 982/1980] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:42 2022] PUT /identity/v3/projects/91be497301804bc9b4a76b4af5b0763e/users/1bab3343b85645998e84839150743f4f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:42.532589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.532873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.533179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.582247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] MFA Rules not processed for user `1bab3343b85645998e84839150743f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:42.583636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:42.654694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 999/1981] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:42.660306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.741494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582d4a-fc69-4e2a-b2c5-c0307331f76a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.746976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.747695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.748065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.748482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.749497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.751636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.783564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 983/1982] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:42.788467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.802332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31bae6-9561-4880-b3c0-2a39c9292935 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.879896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:42.909305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.909945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.910219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.910478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.911138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.913157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.935496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1000/1983] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:42 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:42.939575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.949967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b143c-53dc-442b-9124-84afffa6f074 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.954455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.955060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.955360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.955623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:42.956413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:42.958335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:42.963825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:42.971695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 984/1984] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:42.976028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:42.986440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210da264-5198-4c59-8a74-a19fcecb9697 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:42.991585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:42.992233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:42.992507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:42.992778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] PATH_INFO: `/v3/projects/0a8063df1a3d4fbd9fdc6f6d8261644f/users/1c0be88dafa642ec854453fc1da2b6fa/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:43.009472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8063df1a3d4fbd9fdc6f6d8261644f, user_id=1c0be88dafa642ec854453fc1da2b6fa, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:43.012245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:43.027736 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1001/1985] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:42 2022] PUT /identity/v3/projects/0a8063df1a3d4fbd9fdc6f6d8261644f/users/1c0be88dafa642ec854453fc1da2b6fa/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:43.031661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:43.042551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c722081-6207-4323-a74d-456321df67b6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:43.101263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbded1-c903-43e8-9dd5-bec34b802bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:43.101886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbded1-c903-43e8-9dd5-bec34b802bce admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:43.102155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbded1-c903-43e8-9dd5-bec34b802bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:43.102425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbded1-c903-43e8-9dd5-bec34b802bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:43.103091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbded1-c903-43e8-9dd5-bec34b802bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:43.104725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbded1-c903-43e8-9dd5-bec34b802bce admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:43.115165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 985/1986] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:43.119883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:43.131903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ff9c5-5c1f-41ec-8675-094765bf2e28 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:43.136830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:43.137534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:43.137809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:43.138075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] PATH_INFO: `/v3/projects/0a8063df1a3d4fbd9fdc6f6d8261644f/users/1c0be88dafa642ec854453fc1da2b6fa/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:43.140163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8063df1a3d4fbd9fdc6f6d8261644f, user_id=1c0be88dafa642ec854453fc1da2b6fa, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:43.142883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:43.158042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1002/1987] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:43 2022] PUT /identity/v3/projects/0a8063df1a3d4fbd9fdc6f6d8261644f/users/1c0be88dafa642ec854453fc1da2b6fa/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:43.169814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:43.170029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:43.170297 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:43.198913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] MFA Rules not processed for user `1c0be88dafa642ec854453fc1da2b6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:43.200125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:43.271583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 986/1988] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:43.282964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:43.284783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:43.348693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32733186-e549-418d-aa79-c7aa1d13f8d7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:43.354766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d90d-9bd2-4ed3-85c1-e6a28c627bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:43.355650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d90d-9bd2-4ed3-85c1-e6a28c627bfd service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:43.355890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d90d-9bd2-4ed3-85c1-e6a28c627bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:43.356236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d90d-9bd2-4ed3-85c1-e6a28c627bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:43.367657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d90d-9bd2-4ed3-85c1-e6a28c627bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:43.369504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d90d-9bd2-4ed3-85c1-e6a28c627bfd service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:43.379312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1003/1989] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:43.840628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:43.910233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a5076-470e-4886-96f4-bc00cb40064a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:43.916840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:43.917518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:43.917789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:43.918048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] PATH_INFO: `/v3/users/1bab3343b85645998e84839150743f4f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:43.919301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bab3343b85645998e84839150743f4f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:43.921538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:43.962470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:44.000003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bab3343b85645998e84839150743f4f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.014986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bab3343b85645998e84839150743f4f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.025624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bab3343b85645998e84839150743f4f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.025624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bab3343b85645998e84839150743f4f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.025624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bab3343b85645998e84839150743f4f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.047522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 987/1990] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:43 2022] DELETE /identity/v3/users/1bab3343b85645998e84839150743f4f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:44.052728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:44.053043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:44.053387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:44.083186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:44.083186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:44.144029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1004/1991] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:44.155139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:44.156651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:44.217533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d5f4-0f71-4e02-b97c-42b6a20128e4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:44.221128 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:44.221766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:44.222034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:44.222299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:44.231307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:44.232731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:44.242880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 988/1992] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:44.522254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:44.523758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:44.536413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847983aa-f27b-498b-bd23-c243be4e1fae None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:44.541103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:44.541923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:44.542249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:44.542561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] PATH_INFO: `/v3/projects/91be497301804bc9b4a76b4af5b0763e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:44.544057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91be497301804bc9b4a76b4af5b0763e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:44.546374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:44.586739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:44.598885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91be497301804bc9b4a76b4af5b0763e', 'request_id': 'req-5d58330d-4fda-4eb3-b2b5-203108c0d10d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.605464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91be497301804bc9b4a76b4af5b0763e', 'request_id': 'req-5d58330d-4fda-4eb3-b2b5-203108c0d10d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.613751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91be497301804bc9b4a76b4af5b0763e', 'request_id': 'req-5d58330d-4fda-4eb3-b2b5-203108c0d10d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.624767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] The token cache is being invalidate because project 91be497301804bc9b4a76b4af5b0763e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:44.625081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.625827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.627649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1005/1993] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:44 2022] DELETE /identity/v3/projects/91be497301804bc9b4a76b4af5b0763e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:44.631684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:44.642589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def5252-c81e-4aca-a361-0454c7e5f29c service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:44.698361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:44.698992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:44.699258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:44.699524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] PATH_INFO: `/v3/users/1c0be88dafa642ec854453fc1da2b6fa` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:44.700633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0be88dafa642ec854453fc1da2b6fa)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:44.702617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:44.749480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:44.751486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0be88dafa642ec854453fc1da2b6fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.766819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0be88dafa642ec854453fc1da2b6fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.773703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0be88dafa642ec854453fc1da2b6fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.774424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0be88dafa642ec854453fc1da2b6fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.775226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d1a36c4d-3583-417c-a5d3-430783520c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0be88dafa642ec854453fc1da2b6fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:44.791246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 989/1994] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:44 2022] DELETE /identity/v3/users/1c0be88dafa642ec854453fc1da2b6fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:45.128516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.133967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:45.153533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58330d-4fda-4eb3-b2b5-203108c0d10d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.283873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.284764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.285180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.285652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] PATH_INFO: `/v3/projects/0a8063df1a3d4fbd9fdc6f6d8261644f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.287463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8063df1a3d4fbd9fdc6f6d8261644f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.290839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.358514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8063df1a3d4fbd9fdc6f6d8261644f', 'request_id': 'req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:45.375948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8063df1a3d4fbd9fdc6f6d8261644f', 'request_id': 'req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:45.377880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8063df1a3d4fbd9fdc6f6d8261644f', 'request_id': 'req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:45.391225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] The token cache is being invalidate because project 0a8063df1a3d4fbd9fdc6f6d8261644f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:45.391512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:45.392147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7dfb671a-7f61-4048-9075-fd71ea2c5bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:45.393718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1006/1995] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:45 2022] DELETE /identity/v3/projects/0a8063df1a3d4fbd9fdc6f6d8261644f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:45.398627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.398913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.399182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.418681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:45.419963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:45.479574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 990/1996] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:45.487693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.488151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.488536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.513332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:45.514656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:45.523831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1007/1997] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:45.528266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.538226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e0532-1260-4ec3-800e-c006706e8f5a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.543602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.544211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.544488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.544752 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.545434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:45.545729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.547363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.559889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 991/1998] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:45.564368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.573879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9702-80ab-4a92-89bb-0e2e20e4aeae None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.579157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.579760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.580668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.580934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.581604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.583666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.611752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1008/1999] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:45 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:45.616173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.627042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c90e21-502e-416d-a8d7-b17ffb1abf29 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.687250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.687899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.688115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.688375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.689007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.690988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.715989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 992/2000] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:45 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:45.720710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.732745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e6ae-47c9-4b0e-8efb-ffacd23c3adb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.738549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.739257 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.739734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.740157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.740900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.742712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.755576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1009/2001] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:45.760451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.771031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd948-a016-4b3e-acc0-dbb1420f7929 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.777564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd25cf-0e78-466e-851c-7e842ecf6508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.778120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd25cf-0e78-466e-851c-7e842ecf6508 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.778392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd25cf-0e78-466e-851c-7e842ecf6508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.778660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd25cf-0e78-466e-851c-7e842ecf6508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.779299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd25cf-0e78-466e-851c-7e842ecf6508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.780902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd25cf-0e78-466e-851c-7e842ecf6508 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.792357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 993/2002] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:45.796637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:45.808256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b601-f357-4895-9f1c-654e370fd823 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:45.813434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:45.814076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.814349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.814650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] PATH_INFO: `/v3/projects/9d6b0418ca644d27b3f66a5d2cb23629/users/e7869905d0ca4fba9a743eff960ea467/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.834478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:45.840515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6b0418ca644d27b3f66a5d2cb23629, user_id=e7869905d0ca4fba9a743eff960ea467, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:45.842881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:45.859744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1010/2003] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:45 2022] PUT /identity/v3/projects/9d6b0418ca644d27b3f66a5d2cb23629/users/e7869905d0ca4fba9a743eff960ea467/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:45.871927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:45.872208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:45.872475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:45.902208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] MFA Rules not processed for user `e7869905d0ca4fba9a743eff960ea467`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:45.903421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:45.923238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:45.977452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 994/2004] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:46.011472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:46.013513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:46.082469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ad8e9-0cd9-4c07-82a3-435de688f7bb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:46.086780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdf6f1-bbdd-4342-97a0-4d45473f6a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:46.088007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf6f1-bbdd-4342-97a0-4d45473f6a87 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:46.088304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf6f1-bbdd-4342-97a0-4d45473f6a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:46.089454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf6f1-bbdd-4342-97a0-4d45473f6a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:46.105203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdf6f1-bbdd-4342-97a0-4d45473f6a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:46.106654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdf6f1-bbdd-4342-97a0-4d45473f6a87 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:46.116894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1011/2005] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:46.137649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:46.209093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0267b-4a3d-445b-8043-2a96ffb0c0e4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:46.213696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:46.214333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:46.214604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:46.214898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] PATH_INFO: `/v3/users/e7869905d0ca4fba9a743eff960ea467` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:46.216015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7869905d0ca4fba9a743eff960ea467)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:46.217962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:46.277533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7869905d0ca4fba9a743eff960ea467'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:46.296959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7869905d0ca4fba9a743eff960ea467'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:46.304923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7869905d0ca4fba9a743eff960ea467'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:46.305814 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7869905d0ca4fba9a743eff960ea467'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:46.306525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7869905d0ca4fba9a743eff960ea467'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:46.327030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 995/2006] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:46 2022] DELETE /identity/v3/users/e7869905d0ca4fba9a743eff960ea467 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:46.331627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:46.332721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:46.333174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:46.374492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:46.376462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:46.484268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1012/2007] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:46.492488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:46.495454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:46.549871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:46.574009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0362-e32b-4315-bc38-71aaf4917f42 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:46.584153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1d132-2129-49a0-bf1f-d299e7a8532c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:46.584832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1d132-2129-49a0-bf1f-d299e7a8532c service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:46.585511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1d132-2129-49a0-bf1f-d299e7a8532c service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:46.585793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1d132-2129-49a0-bf1f-d299e7a8532c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:46.596601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1d132-2129-49a0-bf1f-d299e7a8532c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:46.597977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1d132-2129-49a0-bf1f-d299e7a8532c service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:46.613125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 996/2008] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:46.913237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:46.915062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:46.936956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff44e-8a69-4469-8453-da3f4340b87b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:46.941945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:46.942937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:46.942937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:46.943143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] PATH_INFO: `/v3/projects/9d6b0418ca644d27b3f66a5d2cb23629` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:46.944585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6b0418ca644d27b3f66a5d2cb23629)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:46.946603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:46.997938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6b0418ca644d27b3f66a5d2cb23629', 'request_id': 'req-07532f97-184f-4b37-a64c-532f7436b6cf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:47.004899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6b0418ca644d27b3f66a5d2cb23629', 'request_id': 'req-07532f97-184f-4b37-a64c-532f7436b6cf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:47.013325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6b0418ca644d27b3f66a5d2cb23629', 'request_id': 'req-07532f97-184f-4b37-a64c-532f7436b6cf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:47.024074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] The token cache is being invalidate because project 9d6b0418ca644d27b3f66a5d2cb23629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:47.024367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:47.025047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-07532f97-184f-4b37-a64c-532f7436b6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:47.026585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1013/2009] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:46 2022] DELETE /identity/v3/projects/9d6b0418ca644d27b3f66a5d2cb23629 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:47.031554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.032033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.032151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.053139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:47.054420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:47.153617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.154114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.154551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.159764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 997/2010] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:47.176179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:47.177875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:47.188428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1014/2011] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:47.190790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.201168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1456384-71e8-475e-acdc-888507fa4f8a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.206177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.206923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.207299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.207664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.208426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:47.208820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.210575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.224688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 998/2012] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:47.228902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.238836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de102c-3f97-46dc-aedd-cd47722ac461 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.244295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.247751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.248051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.248288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.248952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.250923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.257703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:47.286848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1015/2013] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:47 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:47.291505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.302415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3877-c05c-4f76-9bb3-978460ce09ab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.364400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.365208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.365583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.366045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.366769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.369180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.397140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 999/2014] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:47 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:47.401493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.412151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea795b-b379-47fc-9f95-7d5ac9cb0e9a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.416792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.417630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.417854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.418332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.419135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.421053 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.435047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1016/2015] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:47.436998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.449455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6c079-79cd-4a8c-ae9d-a5fe1368eee6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.456958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab8ade-f122-4068-9a6d-dd5e224ce448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.457736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab8ade-f122-4068-9a6d-dd5e224ce448 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.458012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab8ade-f122-4068-9a6d-dd5e224ce448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.458276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab8ade-f122-4068-9a6d-dd5e224ce448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.458922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab8ade-f122-4068-9a6d-dd5e224ce448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.460551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab8ade-f122-4068-9a6d-dd5e224ce448 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.472926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1000/2016] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:47.477586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.489635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fac48-dc11-4ca6-a73a-ca6028609118 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.495577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.496405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.496528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.496774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] PATH_INFO: `/v3/projects/632bbb23695444e8926df56dbd7c3647/users/9b00e67bc1574b818c837b7437015bfd/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.518631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632bbb23695444e8926df56dbd7c3647, user_id=9b00e67bc1574b818c837b7437015bfd, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.521399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.542147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1017/2017] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:47 2022] PUT /identity/v3/projects/632bbb23695444e8926df56dbd7c3647/users/9b00e67bc1574b818c837b7437015bfd/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:47.552586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.553130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.553526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.608258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] MFA Rules not processed for user `9b00e67bc1574b818c837b7437015bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:47.611867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:47.664357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:47.709809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1001/2018] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:47.717484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.719233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:47.784311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5253-9e71-4e4b-96f2-c57143843082 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.788610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65109f65-3ef2-4a58-ab26-16e65e681f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.789299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65109f65-3ef2-4a58-ab26-16e65e681f8a service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.789684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65109f65-3ef2-4a58-ab26-16e65e681f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.790054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65109f65-3ef2-4a58-ab26-16e65e681f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.800462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65109f65-3ef2-4a58-ab26-16e65e681f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.802058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65109f65-3ef2-4a58-ab26-16e65e681f8a service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:47.816462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1018/2019] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:47.845886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:47.986082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cb12-eb7b-47c9-a7a8-696c72ea2509 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:47.991618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:47.992284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:47.992554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:47.995277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] PATH_INFO: `/v3/users/9b00e67bc1574b818c837b7437015bfd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:47.996032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b00e67bc1574b818c837b7437015bfd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:47.998783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:48.077399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b00e67bc1574b818c837b7437015bfd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.091343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b00e67bc1574b818c837b7437015bfd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.106161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b00e67bc1574b818c837b7437015bfd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.106894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b00e67bc1574b818c837b7437015bfd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.107610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b00e67bc1574b818c837b7437015bfd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.135626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1002/2020] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:47 2022] DELETE /identity/v3/users/9b00e67bc1574b818c837b7437015bfd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:48.140114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:48.140829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:48.141300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:48.162382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:48.163703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:48.229675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1019/2021] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:48.239842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:48.241371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:48.314657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963dcb4-90e9-4ca9-80ad-646f59d39bb5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:48.318851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420b712-5e1a-4a99-9bd3-c16e561f7322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:48.319546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b712-5e1a-4a99-9bd3-c16e561f7322 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:48.319821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b712-5e1a-4a99-9bd3-c16e561f7322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:48.320082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b712-5e1a-4a99-9bd3-c16e561f7322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:48.329301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420b712-5e1a-4a99-9bd3-c16e561f7322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:48.330844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420b712-5e1a-4a99-9bd3-c16e561f7322 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:48.334770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:48.342427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1003/2022] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:48.810163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:48.811616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:48.825702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c9e5-2fb3-4fb6-a43b-4cbcc5163ef2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:48.835358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:48.836407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:48.836662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:48.837214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] PATH_INFO: `/v3/projects/632bbb23695444e8926df56dbd7c3647` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:48.838668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632bbb23695444e8926df56dbd7c3647)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:48.840503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:48.901929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632bbb23695444e8926df56dbd7c3647', 'request_id': 'req-e4ed6873-3931-410c-a447-1446c8670b86'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.909305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:48.916016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632bbb23695444e8926df56dbd7c3647', 'request_id': 'req-e4ed6873-3931-410c-a447-1446c8670b86'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.925811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632bbb23695444e8926df56dbd7c3647', 'request_id': 'req-e4ed6873-3931-410c-a447-1446c8670b86'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.937107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] The token cache is being invalidate because project 632bbb23695444e8926df56dbd7c3647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:48.937826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.940569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e4ed6873-3931-410c-a447-1446c8670b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:48.953227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1020/2023] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:48 2022] DELETE /identity/v3/projects/632bbb23695444e8926df56dbd7c3647 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:49.443657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bc0f-3c42-476e-916e-d2ba2399f783 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:49.444170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bc0f-3c42-476e-916e-d2ba2399f783 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:49.444170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bc0f-3c42-476e-916e-d2ba2399f783 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:49.445991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1004/2024] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:11:49.489197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:49.489441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:49.489800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:49.511120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:49.512540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:49.564373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bc0f-3c42-476e-916e-d2ba2399f783 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:49.575434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5d49bc0f-3c42-476e-916e-d2ba2399f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:49.603884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1021/2025] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:49.615771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:49.617156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:49.630748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e616fa-0130-4d62-82e4-da74ad762935 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:49.636707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:49.637405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:49.637674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:49.637937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:49.646447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bc0f-3c42-476e-916e-d2ba2399f783 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:49.646695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:49.648347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:49.651360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:49.652048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:49.652383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:49.652942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] PATH_INFO: `/v3/users/97e2874025f140ab9167852b12b2ef32` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:49.654674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e2874025f140ab9167852b12b2ef32)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:49.656577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:49.658475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1022/2026] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:11:49.706184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e2874025f140ab9167852b12b2ef32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:49.717841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e2874025f140ab9167852b12b2ef32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:49.724624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e2874025f140ab9167852b12b2ef32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:49.725373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e2874025f140ab9167852b12b2ef32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:49.726010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d6d210ca-34dc-4d95-881f-0ba188f3cc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e2874025f140ab9167852b12b2ef32'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:49.740762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1005/2027] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:49 2022] DELETE /identity/v3/users/97e2874025f140ab9167852b12b2ef32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:49.918117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:49.935005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7a30-bb9b-4650-b561-faca98d2643a service placement] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:49.991861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:49.992494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:49.992765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:49.993059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] PATH_INFO: `/v3/projects/09b8649c0c22454997a09becd8e9b1d1` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:49.994505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b8649c0c22454997a09becd8e9b1d1)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:49.996422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.042788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b8649c0c22454997a09becd8e9b1d1', 'request_id': 'req-6ee31822-7807-4264-9c35-90e697d9ebcf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:50.049135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b8649c0c22454997a09becd8e9b1d1', 'request_id': 'req-6ee31822-7807-4264-9c35-90e697d9ebcf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:50.060060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b8649c0c22454997a09becd8e9b1d1', 'request_id': 'req-6ee31822-7807-4264-9c35-90e697d9ebcf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:50.062244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:50.073972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] The token cache is being invalidate because project 09b8649c0c22454997a09becd8e9b1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:50.074325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:50.074992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6ee31822-7807-4264-9c35-90e697d9ebcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:50.076967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1023/2028] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:49 2022] DELETE /identity/v3/projects/09b8649c0c22454997a09becd8e9b1d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:50.082481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.082766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.083061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.103489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:50.104678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:50.165580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1006/2029] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:50.174693 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.174988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.175241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.195180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:50.196382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:50.204562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1024/2030] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:50.209126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.219341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15f8f-96dc-44db-b2a2-f8b9070e81d5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.225144 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.225742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.226018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.226317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.226963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:50.227258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.228849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.241309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1007/2031] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:50.246027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.255616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265854ea-e629-4ea1-a0b7-cfcff1be7b17 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.261525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.262111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.262384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.262612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.263243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.265253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.294314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1025/2032] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:50 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:50.298300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.305028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:50.308528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9409c0-4940-45c6-b897-f453b5867721 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.381073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.381741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.381954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.382218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.382832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.384792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.409008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1008/2033] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:50 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:50.413554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.424810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90967-921e-47ae-98e8-b2867015ec7b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.430132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.430751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.431022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.431465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.432124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.433781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.445413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1026/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:50.449855 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.460565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d5df-fd96-44bb-bc05-e5da8920ddcb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.465471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa671-1aa8-4104-9326-8305142ff5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.466084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa671-1aa8-4104-9326-8305142ff5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.466347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa671-1aa8-4104-9326-8305142ff5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.466600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa671-1aa8-4104-9326-8305142ff5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.467245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa671-1aa8-4104-9326-8305142ff5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.468898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa671-1aa8-4104-9326-8305142ff5e0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.480914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1009/2035] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:50.485453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.497012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00daa-12f5-49be-a28f-f13c775ae7ec admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.502313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.502992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.503265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.503550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] PATH_INFO: `/v3/projects/db12b2abb1c045e783291ce0c83cc474/users/18dbbff91efc488498fedec43a717bc3/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.523924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db12b2abb1c045e783291ce0c83cc474, user_id=18dbbff91efc488498fedec43a717bc3, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.526638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.540805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1027/2036] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:50 2022] PUT /identity/v3/projects/db12b2abb1c045e783291ce0c83cc474/users/18dbbff91efc488498fedec43a717bc3/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:50.551279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.551672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.551817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.584632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] MFA Rules not processed for user `18dbbff91efc488498fedec43a717bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:50.585883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:50.684160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1010/2037] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:50.695368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:50.697429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:50.756498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce7e2b-8d95-433e-a105-c4f47277a776 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:50.760361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d88852-0943-4ab0-805e-daae752fe3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:50.761002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d88852-0943-4ab0-805e-daae752fe3dc service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:50.761298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d88852-0943-4ab0-805e-daae752fe3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:50.761562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d88852-0943-4ab0-805e-daae752fe3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:50.770015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d88852-0943-4ab0-805e-daae752fe3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:50.771465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d88852-0943-4ab0-805e-daae752fe3dc service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:50.780372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1028/2038] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:51.823989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:51.825872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:51.894279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7bb48-6e6c-4528-b14c-cee809e7eb0b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:51.898894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:51.899615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:51.900255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:51.900255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] PATH_INFO: `/v3/users/050ac15b06e84a6d831c871b8de346aa` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:51.901268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050ac15b06e84a6d831c871b8de346aa)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:51.903189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:51.917381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:51.952326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050ac15b06e84a6d831c871b8de346aa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:51.963622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050ac15b06e84a6d831c871b8de346aa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:51.970260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050ac15b06e84a6d831c871b8de346aa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:51.970946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050ac15b06e84a6d831c871b8de346aa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:51.971542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050ac15b06e84a6d831c871b8de346aa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:51.985522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1011/2039] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:51 2022] DELETE /identity/v3/users/050ac15b06e84a6d831c871b8de346aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:51.990912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:51.991394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:51.991501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.016368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:52.017590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:52.078298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1029/2040] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:52.089099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.090832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:52.153447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1dc3a-827b-4d1b-aaa6-b2804eb5b638 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.157009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6bf1-f6b3-4843-8f89-d25d2a247901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.157639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6bf1-f6b3-4843-8f89-d25d2a247901 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.157908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6bf1-f6b3-4843-8f89-d25d2a247901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.158170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6bf1-f6b3-4843-8f89-d25d2a247901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.167647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6bf1-f6b3-4843-8f89-d25d2a247901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.169246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6bf1-f6b3-4843-8f89-d25d2a247901 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.179155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1012/2041] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:52.458867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.460571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:52.485190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c138ac-c46e-42ea-963c-4e22bd3c5e4d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.490889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.492260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.493068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.493760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] PATH_INFO: `/v3/projects/a5f2f771527844fd85880590f19d0408` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.503684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f2f771527844fd85880590f19d0408)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.505756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.539180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:52.556574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f2f771527844fd85880590f19d0408', 'request_id': 'req-c3277551-c617-4d91-aef4-3a78e41ddccf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:52.562623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f2f771527844fd85880590f19d0408', 'request_id': 'req-c3277551-c617-4d91-aef4-3a78e41ddccf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:52.570462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f2f771527844fd85880590f19d0408', 'request_id': 'req-c3277551-c617-4d91-aef4-3a78e41ddccf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:52.582690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] The token cache is being invalidate because project a5f2f771527844fd85880590f19d0408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:52.582976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:52.583729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c3277551-c617-4d91-aef4-3a78e41ddccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:52.585637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1030/2042] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:52 2022] DELETE /identity/v3/projects/a5f2f771527844fd85880590f19d0408 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:52.590476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.590749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.591016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.613625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:52.614854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:52.679352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1013/2043] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:52.687232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.687516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.687772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.707713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:52.708920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:52.716957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1031/2044] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:52.721325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.731606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745248a-f6ac-496a-a402-b11dcaee2c0d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.737348 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.738016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.738337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.738583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.739273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:11:52.739601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.741391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.754169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1014/2045] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:11:52.758483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.768464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161254dd-0b44-4671-8133-eee323a15c8f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.773551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.774206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.774478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.774742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.775359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.777357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.807325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1032/2046] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:52 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:52.811545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.822645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d313c6-a579-4e58-9f27-82c6b3b4a1a9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.841464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:52.885141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.885748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.886064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.886333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.886968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.889034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.913577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1015/2047] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:52 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:52.917595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.929940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d80c9b-20cf-4fa4-a16e-95f24962bec6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.935333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.935927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.936269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.936490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.941127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.943054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.961011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1033/2048] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:52.962540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:52.974685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef56463-5c54-427a-8d72-e2ed8e4ad671 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:52.979642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570c261-cfa0-4684-a47f-0b9b04a3a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:52.980313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570c261-cfa0-4684-a47f-0b9b04a3a160 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:52.980646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570c261-cfa0-4684-a47f-0b9b04a3a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:52.981006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570c261-cfa0-4684-a47f-0b9b04a3a160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:52.981701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570c261-cfa0-4684-a47f-0b9b04a3a160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:52.983351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570c261-cfa0-4684-a47f-0b9b04a3a160 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:52.996550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1016/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:53.000762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.010983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f47c6f-ef52-45c0-a920-d4823e602ab3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.017364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.018071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.018387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.018610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] PATH_INFO: `/v3/projects/2f4633d0e9c346079df206cbfac13d85/users/4c9140b7e33441cba092b6de5a8a3583/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.033673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4633d0e9c346079df206cbfac13d85, user_id=4c9140b7e33441cba092b6de5a8a3583, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.036355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.050547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1034/2050] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:52 2022] PUT /identity/v3/projects/2f4633d0e9c346079df206cbfac13d85/users/4c9140b7e33441cba092b6de5a8a3583/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:53.062116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.062461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.062669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.091387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] MFA Rules not processed for user `4c9140b7e33441cba092b6de5a8a3583`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:53.092705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:53.157955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1017/2051] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:11:53.162646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.227166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e210a-dd9c-4cee-b887-a922cc079908 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.231957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.232566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.232840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.233137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.233755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.235691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.262432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1035/2052] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:53 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:53.266612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.277874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bf55-c356-4cbe-ba14-77cc4f628314 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.339951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.340569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.340869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.341164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.341766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.343703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.372484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1018/2053] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:53 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:11:53.377280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.388656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d8da-387c-4811-b458-bc3a893ef5ab admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.393687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.394284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.394554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.394847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.395483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.397158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.407882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1036/2054] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:53.411922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.422256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e1876-53d2-4797-9993-00758a83686f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.427093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b820fb-ac4f-42ba-9379-65e425c45459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.427785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b820fb-ac4f-42ba-9379-65e425c45459 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.428061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b820fb-ac4f-42ba-9379-65e425c45459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.428325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b820fb-ac4f-42ba-9379-65e425c45459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.428954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b820fb-ac4f-42ba-9379-65e425c45459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.430563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b820fb-ac4f-42ba-9379-65e425c45459 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.440612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1019/2055] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:53.445081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.455321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387eb29-58bb-4b45-8a8d-3efdc7cd3763 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.460117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.460761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.461075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.461339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] PATH_INFO: `/v3/projects/b6f99a66535a4d758ac2701af0dccb78/users/7ec0e8ec311543b6af3a9e5067e5afb9/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.476352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f99a66535a4d758ac2701af0dccb78, user_id=7ec0e8ec311543b6af3a9e5067e5afb9, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.479097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.490020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:53.494990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1037/2056] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:53 2022] PUT /identity/v3/projects/b6f99a66535a4d758ac2701af0dccb78/users/7ec0e8ec311543b6af3a9e5067e5afb9/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:53.505360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.505671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.505899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.525223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:53.535975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] MFA Rules not processed for user `7ec0e8ec311543b6af3a9e5067e5afb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:53.537490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:53.604098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1020/2057] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:53.608937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.678985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65880-daab-4e6c-a9d5-5e6495f74e9a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.683701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.684301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.684569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.684828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.685478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.687382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.714678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1038/2058] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:11:53 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:53.718877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.730603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28151fdb-815e-4ace-bbad-1452f8db0e43 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.788493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.789158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.789436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.789701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.790446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.792753 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.818172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1021/2059] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:11:53 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:11:53.819364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.838847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725ffca-b304-450a-b7a4-fde2faa3a68b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.845402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.846132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.846413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.846677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.847564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.849269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.865961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1039/2060] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:11:53.866972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.877484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29854e0d-810b-424c-a060-30fdeff537e6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.882617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.883276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.883554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.883826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] PATH_INFO: `/v3/projects/5d86eaf6dee948b293f4d8559a215acc/users/ef8ab85be08d4fa4a9a6a70cb601bb03/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.899389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d86eaf6dee948b293f4d8559a215acc, user_id=ef8ab85be08d4fa4a9a6a70cb601bb03, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.902075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:53.916520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1022/2061] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:53 2022] PUT /identity/v3/projects/5d86eaf6dee948b293f4d8559a215acc/users/ef8ab85be08d4fa4a9a6a70cb601bb03/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:11:53.920739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:53.930660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45422fd-0d26-4152-9ba1-bc0a8b14a035 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:53.989301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560366a-e240-44b5-ad0b-d1249c602391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:53.990013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560366a-e240-44b5-ad0b-d1249c602391 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:53.990284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560366a-e240-44b5-ad0b-d1249c602391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:53.990547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560366a-e240-44b5-ad0b-d1249c602391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:53.991186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560366a-e240-44b5-ad0b-d1249c602391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:53.992754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560366a-e240-44b5-ad0b-d1249c602391 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:54.002974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1040/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:11:54.009255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:54.020227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa372cd-f5cc-4b78-b7c9-122204ef248d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:54.025245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:54.026145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:54.026398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:54.026727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] PATH_INFO: `/v3/projects/5d86eaf6dee948b293f4d8559a215acc/users/ef8ab85be08d4fa4a9a6a70cb601bb03/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:54.028995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d86eaf6dee948b293f4d8559a215acc, user_id=ef8ab85be08d4fa4a9a6a70cb601bb03, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:54.031903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:54.042401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1023/2063] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:11:54 2022] PUT /identity/v3/projects/5d86eaf6dee948b293f4d8559a215acc/users/ef8ab85be08d4fa4a9a6a70cb601bb03/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:54.052646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:54.052928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:54.053227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:54.082396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] MFA Rules not processed for user `ef8ab85be08d4fa4a9a6a70cb601bb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:54.083705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:54.156643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:54.176062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1041/2064] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:54.189694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:54.192722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:54.260628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5555-e78c-44c1-9a96-deb3b85ad50a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:54.264400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:54.265146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:54.265493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:54.265747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:54.270051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:54.333036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:54.334573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:54.343476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1024/2065] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:55.870086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:55.879606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2f049-b543-4900-940d-04c48daa6a61 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:55.883559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:55.884184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:55.884463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:55.884736 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:55.944278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:55.945832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:55.955043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1042/2066] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:56.555370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:56.565306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a535-d1a4-4f2e-b5ef-3357188ccaee service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:56.570105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be917136-1b8d-47d3-ad24-16f21354f504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:56.570711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917136-1b8d-47d3-ad24-16f21354f504 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:56.570983 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917136-1b8d-47d3-ad24-16f21354f504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:56.571246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917136-1b8d-47d3-ad24-16f21354f504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:56.585299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be917136-1b8d-47d3-ad24-16f21354f504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:56.588133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be917136-1b8d-47d3-ad24-16f21354f504 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:56.599266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1025/2067] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:59.222104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:59.223635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:59.290670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02146f4-3664-4c77-acf0-1e037a22ed64 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:59.295090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:59.295720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:59.295989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:59.296281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] PATH_INFO: `/v3/users/18dbbff91efc488498fedec43a717bc3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:59.297431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18dbbff91efc488498fedec43a717bc3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:59.299358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:59.348437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18dbbff91efc488498fedec43a717bc3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.359397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18dbbff91efc488498fedec43a717bc3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.373062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18dbbff91efc488498fedec43a717bc3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.373749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18dbbff91efc488498fedec43a717bc3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.374348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18dbbff91efc488498fedec43a717bc3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.387109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1043/2068] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:59 2022] DELETE /identity/v3/users/18dbbff91efc488498fedec43a717bc3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:59.391773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:59.392295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:59.392295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:59.412490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:59.413941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:59.476293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1026/2069] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:11:59.487691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:59.489373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:59.503770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:59.549261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f090f06-6abb-4f4a-9042-9ca452eca1f7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:59.553262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:59.553871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:59.554145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:59.554393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:59.563538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:59.564954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:59.574534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1044/2070] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:11:59.858291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:59.859807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:59.872657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ca07d-72c9-4579-a202-828905dbfb51 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:59.877718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:59.878358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:59.878629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:59.878919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] PATH_INFO: `/v3/projects/db12b2abb1c045e783291ce0c83cc474` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:59.880098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db12b2abb1c045e783291ce0c83cc474)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:11:59.882247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:11:59.924444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:11:59.925939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:59.933490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db12b2abb1c045e783291ce0c83cc474', 'request_id': 'req-b8393b6f-66fc-446c-a39f-7f1c54096429'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.939943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38db4e3-bd93-483a-aa21-88d22405d288 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:11:59.941909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db12b2abb1c045e783291ce0c83cc474', 'request_id': 'req-b8393b6f-66fc-446c-a39f-7f1c54096429'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.948239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db12b2abb1c045e783291ce0c83cc474', 'request_id': 'req-b8393b6f-66fc-446c-a39f-7f1c54096429'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.958647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] The token cache is being invalidate because project db12b2abb1c045e783291ce0c83cc474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:11:59.958926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.959541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8393b6f-66fc-446c-a39f-7f1c54096429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:11:59.961085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1027/2071] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:11:59 2022] DELETE /identity/v3/projects/db12b2abb1c045e783291ce0c83cc474 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:11:59.965816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eabf4-5813-44dc-a30f-d49d9980b5a4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:11:59.966095 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eabf4-5813-44dc-a30f-d49d9980b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:11:59.966356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eabf4-5813-44dc-a30f-d49d9980b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:11:59.984846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5e6eabf4-5813-44dc-a30f-d49d9980b5a4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:11:59.986252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5e6eabf4-5813-44dc-a30f-d49d9980b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:11:59.996127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:59.999246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:11:59.999874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.000168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.000431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] PATH_INFO: `/v3/users/7be60af968f24e7987645e8e34071813` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.001686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be60af968f24e7987645e8e34071813)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.003645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.048634 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1028/2072] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:00.053956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be60af968f24e7987645e8e34071813'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.058039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.058383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.058698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.062853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be60af968f24e7987645e8e34071813'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.078339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be60af968f24e7987645e8e34071813'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.079166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be60af968f24e7987645e8e34071813'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.079975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0b65ae26-b682-4b32-af7d-e8dd9881d18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be60af968f24e7987645e8e34071813'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.082048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:00.083303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.094190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1029/2073] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:00.099123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.100093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1045/2074] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:11:59 2022] DELETE /identity/v3/users/7be60af968f24e7987645e8e34071813 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:00.104198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.104574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.104910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.109018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f665-5441-4206-bcd2-bf8f28903737 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.131597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:00.133024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.170226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:00.183236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.183909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.184121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.184390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.185087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:00.185391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.187062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.200212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1030/2075] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:12:00.205250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.206725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1046/2076] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:00.216260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.216422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b91f1-e95e-49b3-9854-2a470796db58 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.217767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.221096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.222120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.222120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.222287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.222806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.224954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.254321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1031/2077] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:00.258616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.279156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3b60a-41e3-4367-82b5-9d71d5992075 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.321561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7164-d2d6-4334-a3d7-a7c2bf7779d0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.326043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.326279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.326582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.326851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.326961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.327108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.327230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.327400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.328017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.329986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.336294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.337723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.347514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1047/2078] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:00.352881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1032/2079] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:00.357191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.366866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0c66-a4ec-4e1d-b0f3-8c931d595d31 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.372878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.373533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.373803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.374063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.374700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.376342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.389024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1048/2080] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:00.391322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.403111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc4bf-89e4-4668-96eb-74cd52ef21eb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.409078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a219f-8bbb-46db-bea4-4b46a7b0b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.409714 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a219f-8bbb-46db-bea4-4b46a7b0b43a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.409987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a219f-8bbb-46db-bea4-4b46a7b0b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.410254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a219f-8bbb-46db-bea4-4b46a7b0b43a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.410922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a219f-8bbb-46db-bea4-4b46a7b0b43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.412586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a219f-8bbb-46db-bea4-4b46a7b0b43a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.418160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:00.423248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1033/2081] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:00.427896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.438322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be025-a32c-4d7c-93f0-9d07aa37d743 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.443196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.443840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.444115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.444380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] PATH_INFO: `/v3/projects/db9e3c8ed8c246cb88f5bcbc08e50735/users/cdd1d25d691048fcbbc95f481f8455af/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.460260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9e3c8ed8c246cb88f5bcbc08e50735, user_id=cdd1d25d691048fcbbc95f481f8455af, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.463017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.483299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1049/2082] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:00 2022] PUT /identity/v3/projects/db9e3c8ed8c246cb88f5bcbc08e50735/users/cdd1d25d691048fcbbc95f481f8455af/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:00.489830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.490244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.490515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.533544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] MFA Rules not processed for user `cdd1d25d691048fcbbc95f481f8455af`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:00.534985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.546294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.548588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.617820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ec8f0-93ac-4335-b275-0a3b1aea707c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.620646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1034/2083] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:00.623132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.623734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.624056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.624326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] PATH_INFO: `/v3/users/4c9140b7e33441cba092b6de5a8a3583` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.625768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9140b7e33441cba092b6de5a8a3583)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.627866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.629812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:00.632393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.633779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.690949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9140b7e33441cba092b6de5a8a3583'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.698999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9140b7e33441cba092b6de5a8a3583'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.710881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9140b7e33441cba092b6de5a8a3583'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.711636 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9140b7e33441cba092b6de5a8a3583'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.712335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9140b7e33441cba092b6de5a8a3583'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.722134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1ea2a-5988-4c42-9dea-9c36ec2f4661 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.724604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1050/2084] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:00 2022] DELETE /identity/v3/users/4c9140b7e33441cba092b6de5a8a3583 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:00.725352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.726750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.729041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.729796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.730148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.730414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.732185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.743436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.745122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a56c78-9db2-4682-aee2-b35790ebfec0 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.754522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1035/2085] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:00.756167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.756606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.757056 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.785036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:00.785036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.798367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd35d-7274-40b1-be07-9c6443b48fa6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:00.802433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:00.803099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.803375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.803682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] PATH_INFO: `/v3/projects/3e0dac9844204742881ff2f8a4b57a2f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.804822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0dac9844204742881ff2f8a4b57a2f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:00.806815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:00.863704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1036/2086] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:00.874542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:00.876499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.882893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0dac9844204742881ff2f8a4b57a2f', 'request_id': 'req-887f871d-31ab-4758-b000-9a065f65023e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.889148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0dac9844204742881ff2f8a4b57a2f', 'request_id': 'req-887f871d-31ab-4758-b000-9a065f65023e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.898006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0dac9844204742881ff2f8a4b57a2f', 'request_id': 'req-887f871d-31ab-4758-b000-9a065f65023e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.906361 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:00.909966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] The token cache is being invalidate because project 3e0dac9844204742881ff2f8a4b57a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:00.910251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.910952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-887f871d-31ab-4758-b000-9a065f65023e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:00.912664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1051/2087] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:00 2022] DELETE /identity/v3/projects/3e0dac9844204742881ff2f8a4b57a2f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:00.917552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:00.917828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:00.918126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:00.947532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:00.948692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:00.953285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:00.959641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23129c-29b9-44b5-966a-33b0d743fa23 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.012651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1052/2088] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:01.019038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.019038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.019205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.019205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.019205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.019205 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.020425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.026674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537452-f64e-488a-b0ca-93f0c0a0dd79 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.031263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.031875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.032150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.032416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.032511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] PATH_INFO: `/v3/users/cdd1d25d691048fcbbc95f481f8455af` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.033576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd1d25d691048fcbbc95f481f8455af)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.033879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea746c0c-27f5-4446-8769-8f10257aeb39 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.035488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.043315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1037/2089] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:01.044497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.044807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.045106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.063894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:01.065115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.074549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1038/2090] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:01.079409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.094081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bfe7d-18f3-4c85-b427-a89499faeb36 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.101147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd1d25d691048fcbbc95f481f8455af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.103037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.104019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.104466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.104906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.106188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:01.106305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.108937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.112494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd1d25d691048fcbbc95f481f8455af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.129031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1039/2091] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:12:01.134557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.134981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd1d25d691048fcbbc95f481f8455af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.135801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd1d25d691048fcbbc95f481f8455af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.136440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be7575be-e50d-41e8-beb3-7d37aea13837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd1d25d691048fcbbc95f481f8455af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.149276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d121a-b34a-4b24-b259-9261ae3d91f6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.151588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1053/2092] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:01 2022] DELETE /identity/v3/users/cdd1d25d691048fcbbc95f481f8455af => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:01.156352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.157202 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.158126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.186530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:01.188329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.238691 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.239339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.239646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.239900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.240847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.242561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.275643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1054/2093] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:01.287513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.290683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.292999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1040/2094] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:01 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:01.297460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.300172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.346479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:01.353246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:01.383391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e0b9-9822-4a34-9d6e-07d8ffd47fac admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.387195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017de2-73c4-4560-97c9-d6da9b48a8e0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.390322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.390942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.391215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.391484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.392216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.395607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.430329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1041/2095] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:01 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:01.435169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.443092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.443698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.443969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.444262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.455317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850434-50fd-477d-b064-d228d76501de admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.455681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.459175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.460088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.460718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.461009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.461349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.461980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.463595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.477435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1042/2096] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:01.478533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.486204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1055/2097] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:01.504258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d0a32-eebf-4764-a8f6-8918cf2a1a9d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.515100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.515783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.516057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.516322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.516961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.518589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.541315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1043/2098] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:01.541419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.545159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.547230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.559072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9991d3-dea6-4f7d-ba99-1117d513c761 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.564526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b50825-9a1b-49b4-beae-312cf3d77b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.565315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50825-9a1b-49b4-beae-312cf3d77b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.565839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50825-9a1b-49b4-beae-312cf3d77b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.565991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50825-9a1b-49b4-beae-312cf3d77b9e admin admin] PATH_INFO: `/v3/projects/0b9aaa1fa4ee4f32a8e67071e337d35d/users/48188a0cc131445fbd706c9c3583d08d/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.571052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432d613-4e29-4458-bf92-3f7c35800a1d service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.584008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b50825-9a1b-49b4-beae-312cf3d77b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9aaa1fa4ee4f32a8e67071e337d35d, user_id=48188a0cc131445fbd706c9c3583d08d, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.585253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.585879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.586167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.586419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] PATH_INFO: `/v3/projects/2f4633d0e9c346079df206cbfac13d85` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.587248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b50825-9a1b-49b4-beae-312cf3d77b9e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.587532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4633d0e9c346079df206cbfac13d85)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.589866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.605510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1044/2099] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:01 2022] PUT /identity/v3/projects/0b9aaa1fa4ee4f32a8e67071e337d35d/users/48188a0cc131445fbd706c9c3583d08d/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:01.617183 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.617466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.617736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.651479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] MFA Rules not processed for user `48188a0cc131445fbd706c9c3583d08d`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:01.652683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.656905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4633d0e9c346079df206cbfac13d85', 'request_id': 'req-46d33081-d81d-4868-a0b4-83ccb53e9926'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.668041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4633d0e9c346079df206cbfac13d85', 'request_id': 'req-46d33081-d81d-4868-a0b4-83ccb53e9926'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.678039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4633d0e9c346079df206cbfac13d85', 'request_id': 'req-46d33081-d81d-4868-a0b4-83ccb53e9926'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.692038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] The token cache is being invalidate because project 2f4633d0e9c346079df206cbfac13d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:01.692321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.693392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.696376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1056/2100] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:01 2022] DELETE /identity/v3/projects/2f4633d0e9c346079df206cbfac13d85 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:01.700758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.703460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.732726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1045/2101] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:01.746477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.748443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.784531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33081-d81d-4868-a0b4-83ccb53e9926 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.789498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.790128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.790483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.790838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] PATH_INFO: `/v3/users/7ec0e8ec311543b6af3a9e5067e5afb9` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.793197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec0e8ec311543b6af3a9e5067e5afb9)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.795734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.810040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0a688-269e-42c5-a15d-bf68a36ec180 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.814586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.815239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.815459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.815725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.815846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:01.826282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.827796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.841149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1046/2102] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:01.842272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:01.843774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:01.858913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa251-7e5f-4f05-b49f-f82cde3b296f service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:01.863520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:01.864142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.864406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.864678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] PATH_INFO: `/v3/projects/db9e3c8ed8c246cb88f5bcbc08e50735` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.865868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9e3c8ed8c246cb88f5bcbc08e50735)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:01.866349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec0e8ec311543b6af3a9e5067e5afb9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.867741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:01.875191 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec0e8ec311543b6af3a9e5067e5afb9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.880404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:01.891237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec0e8ec311543b6af3a9e5067e5afb9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.892047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec0e8ec311543b6af3a9e5067e5afb9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.892899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cd9b9aa6-b3ca-4f0e-8367-62eacba71558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec0e8ec311543b6af3a9e5067e5afb9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.909749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1057/2103] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:01 2022] DELETE /identity/v3/users/7ec0e8ec311543b6af3a9e5067e5afb9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:01.926327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9e3c8ed8c246cb88f5bcbc08e50735', 'request_id': 'req-298da9d7-58f2-4f32-8c10-0867f8fefc33'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.935100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9e3c8ed8c246cb88f5bcbc08e50735', 'request_id': 'req-298da9d7-58f2-4f32-8c10-0867f8fefc33'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.943403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9e3c8ed8c246cb88f5bcbc08e50735', 'request_id': 'req-298da9d7-58f2-4f32-8c10-0867f8fefc33'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.955902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] The token cache is being invalidate because project db9e3c8ed8c246cb88f5bcbc08e50735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:01.956260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.957017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-298da9d7-58f2-4f32-8c10-0867f8fefc33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:01.958619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1047/2104] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:01 2022] DELETE /identity/v3/projects/db9e3c8ed8c246cb88f5bcbc08e50735 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:01.964964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:01.965634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:01.966126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:01.991604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:01.992937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.069146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1058/2105] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:02.077014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.077481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.077587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.099554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:02.100831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.113826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1048/2106] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:02.115013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.148048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0af3-c045-4d8d-8f8e-3ca90c26ce6d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.153556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.154158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.157068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.157572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.159752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:02.161019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.163936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.185696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1059/2107] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:12:02.185798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.197564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3c9bd-773e-4e19-a36f-562b30caf4fb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.202914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.203474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.203885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.204153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.204785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.206708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.242769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1049/2108] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:02 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:02.244311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.251862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.253766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.255436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2be336-9a6b-4685-900e-93858fcee2c9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.318579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.319334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.319497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.319766 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.319972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8154-fca0-4d5b-8cda-b0f33ad1ff93 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.320398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.322361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.324562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.325201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.325473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.325735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] PATH_INFO: `/v3/projects/b6f99a66535a4d758ac2701af0dccb78` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.326830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f99a66535a4d758ac2701af0dccb78)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.328709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.339666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:02.349040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1060/2109] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:02 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:02.349865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.360300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb910-4b52-4539-b708-93594a25c41d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.366241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.366881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.367239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.367573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.368575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.370220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.379900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f99a66535a4d758ac2701af0dccb78', 'request_id': 'req-cece196f-4f19-4f9a-82a6-3a603a14d304'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.381329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1061/2110] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:02.385663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.388313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f99a66535a4d758ac2701af0dccb78', 'request_id': 'req-cece196f-4f19-4f9a-82a6-3a603a14d304'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.395168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f99a66535a4d758ac2701af0dccb78', 'request_id': 'req-cece196f-4f19-4f9a-82a6-3a603a14d304'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.396824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ec248-d0c2-49dc-9ee1-1d4cdd3e516a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.403237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:02.408064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] The token cache is being invalidate because project b6f99a66535a4d758ac2701af0dccb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:02.408448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.409712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.411883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1050/2111] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:02 2022] DELETE /identity/v3/projects/b6f99a66535a4d758ac2701af0dccb78 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:02.415516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.416804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.461945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.462677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.462954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.463229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.463930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.465576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.479322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1062/2112] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:02.480658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.482528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.484831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece196f-4f19-4f9a-82a6-3a603a14d304 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.489484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.490123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.490390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.490646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] PATH_INFO: `/v3/users/ef8ab85be08d4fa4a9a6a70cb601bb03` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.491788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8ab85be08d4fa4a9a6a70cb601bb03)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.494082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.496163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9b17d-4cec-4bbb-a8aa-3a0a6b6f230f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.501136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ea95-93a9-42bb-b86b-a18970f1c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.501777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ea95-93a9-42bb-b86b-a18970f1c798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.502052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ea95-93a9-42bb-b86b-a18970f1c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.502316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ea95-93a9-42bb-b86b-a18970f1c798 admin admin] PATH_INFO: `/v3/projects/521ead5d24864e108c9104176660d7a9/users/58ae12b445414905bda623578939aae0/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.518044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ea95-93a9-42bb-b86b-a18970f1c798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521ead5d24864e108c9104176660d7a9, user_id=58ae12b445414905bda623578939aae0, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.521234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ea95-93a9-42bb-b86b-a18970f1c798 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.534852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1063/2113] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:02 2022] PUT /identity/v3/projects/521ead5d24864e108c9104176660d7a9/users/58ae12b445414905bda623578939aae0/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:02.539937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.540276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.540546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.543399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8ab85be08d4fa4a9a6a70cb601bb03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.555786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8ab85be08d4fa4a9a6a70cb601bb03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.558842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:02.560021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.562778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8ab85be08d4fa4a9a6a70cb601bb03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.563478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8ab85be08d4fa4a9a6a70cb601bb03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.564277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8ab85be08d4fa4a9a6a70cb601bb03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:02.579301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1051/2114] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:02 2022] DELETE /identity/v3/users/ef8ab85be08d4fa4a9a6a70cb601bb03 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:02.632893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1064/2115] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:02.644997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.647279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.712266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91507a6-fd3f-4970-b37f-62fb0ad9bf74 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.716118 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232776f-b037-4cba-b6cb-4703626d30a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.716781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232776f-b037-4cba-b6cb-4703626d30a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.717087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232776f-b037-4cba-b6cb-4703626d30a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.717356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232776f-b037-4cba-b6cb-4703626d30a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.767941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:02.799061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232776f-b037-4cba-b6cb-4703626d30a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.800516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232776f-b037-4cba-b6cb-4703626d30a3 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.810523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1052/2116] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:02.910088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:02.911689 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:02.923998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095acdc-b8ef-49f7-a891-4fd02645f3f9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:02.932565 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:02.933641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:02.933919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:02.934183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] PATH_INFO: `/v3/projects/5d86eaf6dee948b293f4d8559a215acc` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:02.935795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d86eaf6dee948b293f4d8559a215acc)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:02.937881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:02.996637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d86eaf6dee948b293f4d8559a215acc', 'request_id': 'req-c432a812-3b37-4066-ad6d-063ec23d046d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:03.003859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d86eaf6dee948b293f4d8559a215acc', 'request_id': 'req-c432a812-3b37-4066-ad6d-063ec23d046d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:03.006580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:03.014903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d86eaf6dee948b293f4d8559a215acc', 'request_id': 'req-c432a812-3b37-4066-ad6d-063ec23d046d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:03.029642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] The token cache is being invalidate because project 5d86eaf6dee948b293f4d8559a215acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:03.029924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:03.030651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c432a812-3b37-4066-ad6d-063ec23d046d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:03.032349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1065/2117] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:02 2022] DELETE /identity/v3/projects/5d86eaf6dee948b293f4d8559a215acc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:03.037271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.037633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.037974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.060509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:03.061840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:03.131883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1053/2118] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:03.141253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.141598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.141893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.162514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:03.165143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:03.175171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1066/2119] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:03.180369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.194158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80bfa-ff52-4ef7-bf0c-b311f2cbae75 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.199512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.200212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.200546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.200875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.201664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:03.202020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.204710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.218140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1054/2120] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:12:03.222756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.234366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77861e2-b9d2-44d6-a496-e00aa1c130d7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.241188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.241804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.242073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.242336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.243370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.250707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.285765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1067/2121] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:03.286920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.298153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eddee4-1032-44f7-a419-99c8ce61f23b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.359244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.359859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.360130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.360393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.361184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.363413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.394677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1055/2122] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:03.399184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.409313 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264dae2-e7b4-432d-802c-4f2aa388189b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.414425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.415036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.415314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.415583 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.416312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.418118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.442716 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1068/2123] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:03.446954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.460288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b04d-82d2-42e3-a381-b8e0fae6e811 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.466835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c66b66-009c-4f4a-a9b3-ac36cf6d3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.467519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c66b66-009c-4f4a-a9b3-ac36cf6d3121 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.467801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c66b66-009c-4f4a-a9b3-ac36cf6d3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.469446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c66b66-009c-4f4a-a9b3-ac36cf6d3121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.469446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c66b66-009c-4f4a-a9b3-ac36cf6d3121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.470561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c66b66-009c-4f4a-a9b3-ac36cf6d3121 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.483869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1056/2124] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:03.489148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.523534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97248-d00b-4d6c-9d37-aa1cb8ee08f8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.527649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.528100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.528389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.544115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57157ce4-7de6-4279-8f42-ffa6f5f8c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.545084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57157ce4-7de6-4279-8f42-ffa6f5f8c751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.545570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57157ce4-7de6-4279-8f42-ffa6f5f8c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.545850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57157ce4-7de6-4279-8f42-ffa6f5f8c751 admin admin] PATH_INFO: `/v3/projects/1b3d6815c82c42a78af0b4a3fc4f0ce1/users/a9e39d7c21e7409ab5e52ee19a266323/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.563707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57157ce4-7de6-4279-8f42-ffa6f5f8c751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3d6815c82c42a78af0b4a3fc4f0ce1, user_id=a9e39d7c21e7409ab5e52ee19a266323, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.564322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] MFA Rules not processed for user `58ae12b445414905bda623578939aae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:03.565796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:03.566572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57157ce4-7de6-4279-8f42-ffa6f5f8c751 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.585968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1069/2125] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:03 2022] PUT /identity/v3/projects/1b3d6815c82c42a78af0b4a3fc4f0ce1/users/a9e39d7c21e7409ab5e52ee19a266323/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:03.595977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.596185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.596450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.597873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:03.633759 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] MFA Rules not processed for user `a9e39d7c21e7409ab5e52ee19a266323`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:03.635738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:03.656543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1057/2126] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:03.660928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.662472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:03.679284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682ec0-7773-4e7d-9a00-29e059a72842 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.723823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1070/2127] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:03.735705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.737796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:03.750584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.751744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.752028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.752345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.752967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.754907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.791051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1058/2128] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/projects => generated 403 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:03.795941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.866355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc548cf-00a8-4153-9bfd-e7e66efff822 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.896955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bbafa-6958-4ffd-a304-ccfb808be334 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.909574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:03.910619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.911304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.911529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.911905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.912750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.914665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.950757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.951346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.951625 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.951940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.953174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1059/2129] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:03 2022] POST /identity/v3/users => generated 308 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:03.958226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:03.970003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787684a7-d6e9-40ba-a0df-99820f77c8e1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:03.975599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:03.976204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:03.976518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:03.976737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:03.977414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:03.979012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:03.993805 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1060/2130] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:03.994837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:04.004442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269987c6-8902-4b84-a6bf-2ba71a931530 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:04.009049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:04.009678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:04.009952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:04.010227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] PATH_INFO: `/v3/projects/c2b9d83c5f0b49279754b8dd352058b6/users/4831aad843f848b09100190fe519ab94/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:04.024710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b9d83c5f0b49279754b8dd352058b6, user_id=4831aad843f848b09100190fe519ab94, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:04.027443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:04.027573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:04.028040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:04.038259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1071/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:04.043266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1061/2132] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:03 2022] PUT /identity/v3/projects/c2b9d83c5f0b49279754b8dd352058b6/users/4831aad843f848b09100190fe519ab94/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:04.047144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:04.057846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ca35-dada-41d7-bd63-4809838a83a3 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:04.120327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c06b-57a4-4b54-9c6d-f15ff05f8b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:04.121239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c06b-57a4-4b54-9c6d-f15ff05f8b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:04.121608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c06b-57a4-4b54-9c6d-f15ff05f8b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:04.122336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c06b-57a4-4b54-9c6d-f15ff05f8b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:04.122988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c06b-57a4-4b54-9c6d-f15ff05f8b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:04.129052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c06b-57a4-4b54-9c6d-f15ff05f8b02 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:04.140681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1072/2133] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:04.144944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:04.151653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:04.156785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2e84-8ec5-4438-8201-3da14b4fc407 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:04.162133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917767-bb69-4f97-b1d5-d2b61cf513e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:04.162715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917767-bb69-4f97-b1d5-d2b61cf513e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:04.163020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917767-bb69-4f97-b1d5-d2b61cf513e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:04.163314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917767-bb69-4f97-b1d5-d2b61cf513e6 admin admin] PATH_INFO: `/v3/projects/c2b9d83c5f0b49279754b8dd352058b6/users/4831aad843f848b09100190fe519ab94/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:04.165431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917767-bb69-4f97-b1d5-d2b61cf513e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b9d83c5f0b49279754b8dd352058b6, user_id=4831aad843f848b09100190fe519ab94, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:04.168225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917767-bb69-4f97-b1d5-d2b61cf513e6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:04.179102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1062/2134] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:04 2022] PUT /identity/v3/projects/c2b9d83c5f0b49279754b8dd352058b6/users/4831aad843f848b09100190fe519ab94/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:04.823224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8373-5b1c-4e77-97b7-16f4d13dc465 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:04.824121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8373-5b1c-4e77-97b7-16f4d13dc465 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:04.824121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8373-5b1c-4e77-97b7-16f4d13dc465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:04.852395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b61d8373-5b1c-4e77-97b7-16f4d13dc465 None None] MFA Rules not processed for user `4831aad843f848b09100190fe519ab94`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:04.853661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b61d8373-5b1c-4e77-97b7-16f4d13dc465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:04.929881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1073/2135] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:06.066340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf56b82-11ff-44a2-88cb-a8b6817423b5 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:06.067279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf56b82-11ff-44a2-88cb-a8b6817423b5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:06.067562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf56b82-11ff-44a2-88cb-a8b6817423b5 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:06.068930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1063/2136] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:12:06.098250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:06.099185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:06.099457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:06.108122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:06.122642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] MFA Rules not processed for user `6fd9a24c27d14095b4a7d1cbd538d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:06.124376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:06.136021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf56b82-11ff-44a2-88cb-a8b6817423b5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:06.199249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1074/2137] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:06.210574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:06.212129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:06.215965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf56b82-11ff-44a2-88cb-a8b6817423b5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:06.226103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:06.226756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:06.226907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfcec-055b-4841-93c6-636a402c575d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:06.227012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:06.227280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] PATH_INFO: `/v3/users/58ae12b445414905bda623578939aae0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:06.228404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ae12b445414905bda623578939aae0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:06.230615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:06.232584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:06.233311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:06.233582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:06.233852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:06.243608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:06.245389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:06.256295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1075/2138] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:06.294246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ae12b445414905bda623578939aae0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.319892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ae12b445414905bda623578939aae0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.329273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ae12b445414905bda623578939aae0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.330025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ae12b445414905bda623578939aae0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.331235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ae12b445414905bda623578939aae0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.347719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1064/2139] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:06 2022] DELETE /identity/v3/users/58ae12b445414905bda623578939aae0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:06.520633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:06.543427 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ec52-9364-49f9-8712-f0fc4d759f04 service placement] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:06.602674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:06.603238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:06.603556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:06.603826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] PATH_INFO: `/v3/projects/521ead5d24864e108c9104176660d7a9` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:06.605098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521ead5d24864e108c9104176660d7a9)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:06.607054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:06.658299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521ead5d24864e108c9104176660d7a9', 'request_id': 'req-ec3e6763-a329-421a-8b85-4e60d8b6e627'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.664420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521ead5d24864e108c9104176660d7a9', 'request_id': 'req-ec3e6763-a329-421a-8b85-4e60d8b6e627'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.673357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521ead5d24864e108c9104176660d7a9', 'request_id': 'req-ec3e6763-a329-421a-8b85-4e60d8b6e627'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.685273 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] The token cache is being invalidate because project 521ead5d24864e108c9104176660d7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:06.685614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.686317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.688155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1076/2140] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:06 2022] DELETE /identity/v3/projects/521ead5d24864e108c9104176660d7a9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:06.692435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:06.694044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:06.707959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbd391-4df9-444c-80cd-a16f436b1d1a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:06.769155 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:06.769873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:06.770232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:06.770468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] PATH_INFO: `/v3/users/4831aad843f848b09100190fe519ab94` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:06.771704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4831aad843f848b09100190fe519ab94)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:06.773770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:06.787675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:06.821928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4831aad843f848b09100190fe519ab94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.834612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4831aad843f848b09100190fe519ab94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.841552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4831aad843f848b09100190fe519ab94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.842237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4831aad843f848b09100190fe519ab94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.842829 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e4c22f89-d985-4f52-8fa0-0d91758b971b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4831aad843f848b09100190fe519ab94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:06.855449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1065/2141] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:06 2022] DELETE /identity/v3/users/4831aad843f848b09100190fe519ab94 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:07.029099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.030569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:07.048953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6763-a329-421a-8b85-4e60d8b6e627 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.061619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:07.107482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.108148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.108421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.108685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] PATH_INFO: `/v3/projects/c2b9d83c5f0b49279754b8dd352058b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.110661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b9d83c5f0b49279754b8dd352058b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.112591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.166201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b9d83c5f0b49279754b8dd352058b6', 'request_id': 'req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:07.172367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b9d83c5f0b49279754b8dd352058b6', 'request_id': 'req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:07.181534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b9d83c5f0b49279754b8dd352058b6', 'request_id': 'req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:07.192961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] The token cache is being invalidate because project c2b9d83c5f0b49279754b8dd352058b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:07.193368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:07.194119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d66e502a-4f84-4ff6-aa95-5e619a5d8bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:07.195837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1077/2142] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:07 2022] DELETE /identity/v3/projects/c2b9d83c5f0b49279754b8dd352058b6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:07.202257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.202811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.202811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.223370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:07.224799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:07.289143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1066/2143] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:07.297078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.297375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.297638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.317398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:07.318584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:07.326490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1078/2144] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:07.330832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.341133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4dc01-6625-4058-b1ca-96c6f3a2a2c7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.345749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.346342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.346646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.346911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.347585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:07.347879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.349650 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.360957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1067/2145] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:12:07.365295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.375297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ad6f6-8d45-4904-acda-54b80f40ee59 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.380241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.380852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.381180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.381449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.382067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.383958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.423958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1079/2146] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:07.425885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.437247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff342ce-87cb-434c-811f-0f03244bd220 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.501527 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.502153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.502433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.502703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.503364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.506188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.538222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1068/2147] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:07.542266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.554598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d09d-2151-4ba5-9216-d026cb3a3837 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.559720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.559982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.560227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.560491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.561160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.562894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.577037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1080/2148] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:07.579672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.591401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48659e82-41f8-46c5-af4c-9abe8d0d0af6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.596462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aab7b-1f4f-4b72-b9de-bdf485e108ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.597090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aab7b-1f4f-4b72-b9de-bdf485e108ef admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.597367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aab7b-1f4f-4b72-b9de-bdf485e108ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.597642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aab7b-1f4f-4b72-b9de-bdf485e108ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.598272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aab7b-1f4f-4b72-b9de-bdf485e108ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.600011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aab7b-1f4f-4b72-b9de-bdf485e108ef admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.601312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:07.615229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1069/2149] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:07.616179 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.627663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5aadf-6350-41a8-941a-2a4146f85a1c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.632251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.632898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.633296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.633566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] PATH_INFO: `/v3/projects/36acdedac6a242f2b8eb8468fc7c3634/users/c3dfa17c895349b1aa093e45fa772e55/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.650180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36acdedac6a242f2b8eb8468fc7c3634, user_id=c3dfa17c895349b1aa093e45fa772e55, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.653318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.666858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1081/2150] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:07 2022] PUT /identity/v3/projects/36acdedac6a242f2b8eb8468fc7c3634/users/c3dfa17c895349b1aa093e45fa772e55/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:07.678437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.678637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.678962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.712892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] MFA Rules not processed for user `c3dfa17c895349b1aa093e45fa772e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:07.714136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:07.778321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1070/2151] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:07.783166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.837694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:07.857724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcad886-8365-4223-80e1-0db22fea5e42 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:07.862370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:07.862994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:07.863272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:07.863536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:07.864227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:07.866253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:07.893600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1082/2152] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:07.898250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:07.911813 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6e2fd-747b-4a8a-b3d9-40a35ef5ef06 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.004516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.005425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.005779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.006109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.006892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.009958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.035308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1071/2153] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:07 2022] POST /identity/v3/users => generated 311 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:08.039480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:08.049762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94cede-7a48-4e26-95a5-9bd1e9c4a9e3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.054708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.055305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.055572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.055838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.056471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.058134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.068574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1083/2154] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:08.072606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:08.082848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab5428-4000-444e-8183-647b8189c9ed admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.088291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.089014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.089321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.089586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] PATH_INFO: `/v3/projects/6739cd9102004d71b927bd353a944ccc/users/e06620a9084047b49dbfeebe25498302/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.106341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6739cd9102004d71b927bd353a944ccc, user_id=e06620a9084047b49dbfeebe25498302, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.109218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.125604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1072/2155] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:08 2022] PUT /identity/v3/projects/6739cd9102004d71b927bd353a944ccc/users/e06620a9084047b49dbfeebe25498302/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:08.129894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:08.140776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913e49-d00d-4a50-941d-7e075f78bc38 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.198141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4ddc-7e8c-4e86-87cf-7c58eba8035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.198767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4ddc-7e8c-4e86-87cf-7c58eba8035d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.199017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4ddc-7e8c-4e86-87cf-7c58eba8035d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.199307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4ddc-7e8c-4e86-87cf-7c58eba8035d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.199945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4ddc-7e8c-4e86-87cf-7c58eba8035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.201651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4ddc-7e8c-4e86-87cf-7c58eba8035d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.211399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1084/2156] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:08.215816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:08.226702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff11d-63f7-4831-aa47-9ad2bd2f04f1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.232216 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.232857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.233160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.233425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] PATH_INFO: `/v3/projects/6739cd9102004d71b927bd353a944ccc/users/e06620a9084047b49dbfeebe25498302/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.235605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6739cd9102004d71b927bd353a944ccc, user_id=e06620a9084047b49dbfeebe25498302, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.238278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.249150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1073/2157] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:08 2022] PUT /identity/v3/projects/6739cd9102004d71b927bd353a944ccc/users/e06620a9084047b49dbfeebe25498302/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:08.259158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.259443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.259712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.287455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] MFA Rules not processed for user `e06620a9084047b49dbfeebe25498302`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:08.288699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:08.358862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1085/2158] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:08.374427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:08.376490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:08.419741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:08.438653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f960-87a6-4b89-87cb-3ebbefeab0c9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.442467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.443072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.443438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.443783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.453231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.454651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.463777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1074/2159] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:08.624527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:08.635079 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e44aa-e464-4792-9a68-9392892fc781 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:08.639282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:08.639912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:08.640207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:08.640486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:08.675638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:08.702546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:08.704152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:08.714871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1086/2160] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:14.059646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:14.123151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65f26a-2c40-47b9-bce7-2098fc3c851a service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:14.128288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:14.128847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.129176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.129467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] PATH_INFO: `/v3/users/c3dfa17c895349b1aa093e45fa772e55` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.130565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3dfa17c895349b1aa093e45fa772e55)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:14.132531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:14.185641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3dfa17c895349b1aa093e45fa772e55'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.196686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:14.198691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:14.199685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3dfa17c895349b1aa093e45fa772e55'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.207503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3dfa17c895349b1aa093e45fa772e55'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.208264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3dfa17c895349b1aa093e45fa772e55'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.208943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cdfc2b42-8cad-4295-a42a-81c7f4883223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3dfa17c895349b1aa093e45fa772e55'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.213171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec37f0-da7b-4462-a561-f61ba80496af service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:14.219707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:14.220634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.220911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.221206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] PATH_INFO: `/v3/users/a9e39d7c21e7409ab5e52ee19a266323` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.222340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e39d7c21e7409ab5e52ee19a266323)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:14.224419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1075/2161] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:14 2022] DELETE /identity/v3/users/c3dfa17c895349b1aa093e45fa772e55 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:14.224530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:14.228823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.229236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.229570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.248699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:14.249954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:14.279154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e39d7c21e7409ab5e52ee19a266323'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.288011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e39d7c21e7409ab5e52ee19a266323'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.301720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e39d7c21e7409ab5e52ee19a266323'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.302677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e39d7c21e7409ab5e52ee19a266323'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.303552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-1403408e-f148-41ee-baaf-52b558267fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e39d7c21e7409ab5e52ee19a266323'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:14.309377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:14.317799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1087/2162] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:14 2022] DELETE /identity/v3/users/a9e39d7c21e7409ab5e52ee19a266323 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:14.329467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1076/2163] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:14.334762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.335350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.335832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.339894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:14.341392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:14.357658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:14.358862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:14.418190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e1d13-96dc-44ac-8c2c-8fa341eac6e4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:14.426439 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1088/2164] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:14.443073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:14.526691 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:14.527671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.528212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.528656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.542531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:14.545719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:14.548453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb563-3d27-446f-bb8f-db2c7dd72ada None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:14.549135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:14.554302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:14.556307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.557141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.557650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.567712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1077/2165] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:14.571291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:14.573308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:14.586842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1089/2166] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:14.946360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:14.947864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:14.962036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482b232-48dd-416c-928b-cc5d4465276f service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:14.967471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:14.968400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:14.968757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:14.969119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] PATH_INFO: `/v3/projects/36acdedac6a242f2b8eb8468fc7c3634` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:14.971596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36acdedac6a242f2b8eb8468fc7c3634)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:14.974724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:14.976034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:14.979189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:14.995165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f69e-76e2-4aaf-83c4-edd683d5199f service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:15.013928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:15.014664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.014949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.016188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] PATH_INFO: `/v3/projects/1b3d6815c82c42a78af0b4a3fc4f0ce1` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.017471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3d6815c82c42a78af0b4a3fc4f0ce1)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:15.019620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:15.039061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36acdedac6a242f2b8eb8468fc7c3634', 'request_id': 'req-b4e4278e-0fd8-4303-8554-67dfffbedd76'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.048219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36acdedac6a242f2b8eb8468fc7c3634', 'request_id': 'req-b4e4278e-0fd8-4303-8554-67dfffbedd76'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.056564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36acdedac6a242f2b8eb8468fc7c3634', 'request_id': 'req-b4e4278e-0fd8-4303-8554-67dfffbedd76'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.074026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] The token cache is being invalidate because project 36acdedac6a242f2b8eb8468fc7c3634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:15.074734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.074832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3d6815c82c42a78af0b4a3fc4f0ce1', 'request_id': 'req-8baf105a-b179-4317-8cb8-35ff7b1c7278'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.074942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.076445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1078/2167] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:14 2022] DELETE /identity/v3/projects/36acdedac6a242f2b8eb8468fc7c3634 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:15.080349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:15.081354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3d6815c82c42a78af0b4a3fc4f0ce1', 'request_id': 'req-8baf105a-b179-4317-8cb8-35ff7b1c7278'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.081795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:15.090118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3d6815c82c42a78af0b4a3fc4f0ce1', 'request_id': 'req-8baf105a-b179-4317-8cb8-35ff7b1c7278'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.100794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] The token cache is being invalidate because project 1b3d6815c82c42a78af0b4a3fc4f0ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:15.101107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.101712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.103301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1090/2168] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:14 2022] DELETE /identity/v3/projects/1b3d6815c82c42a78af0b4a3fc4f0ce1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:15.134485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:15.157090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4278e-0fd8-4303-8554-67dfffbedd76 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:15.238340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:15.239023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.239295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.239562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] PATH_INFO: `/v3/users/e06620a9084047b49dbfeebe25498302` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.240721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06620a9084047b49dbfeebe25498302)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:15.243114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:15.297578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06620a9084047b49dbfeebe25498302'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.311075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06620a9084047b49dbfeebe25498302'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.319157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06620a9084047b49dbfeebe25498302'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.321935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06620a9084047b49dbfeebe25498302'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.322607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2ed2c76a-c58f-47fa-81e0-850ad24360e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06620a9084047b49dbfeebe25498302'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.341856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1079/2169] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:15 2022] DELETE /identity/v3/users/e06620a9084047b49dbfeebe25498302 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:15.625963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:15.627526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:15.643882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf105a-b179-4317-8cb8-35ff7b1c7278 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:15.706626 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:15.707256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.707527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.707793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] PATH_INFO: `/v3/projects/6739cd9102004d71b927bd353a944ccc` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.709009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6739cd9102004d71b927bd353a944ccc)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:15.710945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:15.758426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6739cd9102004d71b927bd353a944ccc', 'request_id': 'req-9f41c45a-347f-4211-888b-c56a3d710105'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.764591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6739cd9102004d71b927bd353a944ccc', 'request_id': 'req-9f41c45a-347f-4211-888b-c56a3d710105'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.774335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6739cd9102004d71b927bd353a944ccc', 'request_id': 'req-9f41c45a-347f-4211-888b-c56a3d710105'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.784861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] The token cache is being invalidate because project 6739cd9102004d71b927bd353a944ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:15.785176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.785796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9f41c45a-347f-4211-888b-c56a3d710105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:15.787432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1091/2170] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:15 2022] DELETE /identity/v3/projects/6739cd9102004d71b927bd353a944ccc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:15.792291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.792571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.792838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.813185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:15.814393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:15.882455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1080/2171] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:15.891513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.891783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.892055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.902914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:15.922620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:15.922620 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:15.931137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1092/2172] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:15.935651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:15.946203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab682fe-25bb-4d40-a8ca-d7e19d35b987 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:15.951203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:15.951799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.952065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.952325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.952965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:15.953293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:15.954881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:15.957232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:15.966834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1081/2173] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:12:15.971219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:15.980559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf55c8-2d61-4507-a210-9634a99648ac None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:15.985328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:15.985920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:15.986194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:15.986459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:15.987076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:15.989026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.017941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1093/2174] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:15 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:16.022013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.032528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf58f-a8ad-4d35-8a38-ec42860a5686 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.093459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.095007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.095325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.095623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.096298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.098374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.122883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1082/2175] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:16 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:16.127039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.137479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44135a-32d8-4746-bd66-02400ad9dc68 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.141967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.142561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.142832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.143093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.143726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.145363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.155417 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1094/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:16.159448 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.170245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2166-0ce3-4c1b-9e27-9eff292188bf admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.175316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bb1b0-e288-4a52-a5a5-f0beb03485ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.175882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bb1b0-e288-4a52-a5a5-f0beb03485ad admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.176150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bb1b0-e288-4a52-a5a5-f0beb03485ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.176410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bb1b0-e288-4a52-a5a5-f0beb03485ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.177018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bb1b0-e288-4a52-a5a5-f0beb03485ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.178624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bb1b0-e288-4a52-a5a5-f0beb03485ad admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.189470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1083/2177] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:16.193677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.204473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8acb63-987e-4fdd-bd6e-08b298283247 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.210360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.211011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.211278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.211543 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] PATH_INFO: `/v3/projects/81b12223e16f435cbccff20283524f10/users/347836c33a2549fab5b7355f7d3fb0f9/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.226326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b12223e16f435cbccff20283524f10, user_id=347836c33a2549fab5b7355f7d3fb0f9, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.229025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.243981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1095/2178] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:16 2022] PUT /identity/v3/projects/81b12223e16f435cbccff20283524f10/users/347836c33a2549fab5b7355f7d3fb0f9/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:16.254411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.254696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.254958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.283518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] MFA Rules not processed for user `347836c33a2549fab5b7355f7d3fb0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:16.284735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:16.353522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1084/2179] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:16.358226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.421115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b415a-cab4-4770-800d-5569f86308a2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.425760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.426366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.426642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.426908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.427545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.429612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.462682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1096/2180] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:16.467108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.478934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd873-51a2-429a-86e7-7c625f59dcbd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.544301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.544927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.545233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.545503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.546134 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.548101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.558167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:16.571725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1085/2181] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:16 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:16.575747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.587227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed96e1a-6fc2-414f-896d-70f99784e81e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.592656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.593361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.593633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.593892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.594535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.596190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.611861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1097/2182] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:16.612726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.623646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb694c-8334-46b2-9a75-405dbadf8033 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.628584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.629267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.629544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.629821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] PATH_INFO: `/v3/projects/84b22e6413f14b9992414379437a1009/users/8b2fdaab1120478ead8f6c5e1a1969e0/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.644480 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b22e6413f14b9992414379437a1009, user_id=8b2fdaab1120478ead8f6c5e1a1969e0, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.647161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.660835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1086/2183] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:16 2022] PUT /identity/v3/projects/84b22e6413f14b9992414379437a1009/users/8b2fdaab1120478ead8f6c5e1a1969e0/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:16.664843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.674968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221fcb-dad5-4be8-b594-f0a8b9b43db2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.743738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b9671-60f6-4b0e-8d61-ab7ddd4567e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.744346 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9671-60f6-4b0e-8d61-ab7ddd4567e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.744675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9671-60f6-4b0e-8d61-ab7ddd4567e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.744922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9671-60f6-4b0e-8d61-ab7ddd4567e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.745593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9671-60f6-4b0e-8d61-ab7ddd4567e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.747190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9671-60f6-4b0e-8d61-ab7ddd4567e8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.758029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1098/2184] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:16.762424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.772821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cd486-e72b-410b-83fe-d49e9449927c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.777576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.778213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.778493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.778763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] PATH_INFO: `/v3/projects/84b22e6413f14b9992414379437a1009/users/8b2fdaab1120478ead8f6c5e1a1969e0/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.780689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b22e6413f14b9992414379437a1009, user_id=8b2fdaab1120478ead8f6c5e1a1969e0, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:16.783398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:16.793860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1087/2185] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:16 2022] PUT /identity/v3/projects/84b22e6413f14b9992414379437a1009/users/8b2fdaab1120478ead8f6c5e1a1969e0/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:16.803956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.804241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.804506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:16.826483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:16.834611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] MFA Rules not processed for user `8b2fdaab1120478ead8f6c5e1a1969e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:16.836137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:16.910887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1099/2186] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:16.921806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:16.923495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:16.986445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482117-9c68-4d2c-994e-10cf6c9c825b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:16.990295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf767d5a-a2fd-4073-97ac-6ba0c479f905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:16.990904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf767d5a-a2fd-4073-97ac-6ba0c479f905 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:16.991172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf767d5a-a2fd-4073-97ac-6ba0c479f905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:16.991437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf767d5a-a2fd-4073-97ac-6ba0c479f905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:17.001629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf767d5a-a2fd-4073-97ac-6ba0c479f905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:17.003102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf767d5a-a2fd-4073-97ac-6ba0c479f905 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:17.012919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1088/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:17.602280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:17.681724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d14e-9351-40f7-b473-e7f9cabc31d7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:17.686295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:17.686918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:17.687186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:17.687446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] PATH_INFO: `/v3/users/347836c33a2549fab5b7355f7d3fb0f9` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:17.688564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=347836c33a2549fab5b7355f7d3fb0f9)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:17.690519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:17.740844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347836c33a2549fab5b7355f7d3fb0f9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:17.749608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347836c33a2549fab5b7355f7d3fb0f9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:17.763595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347836c33a2549fab5b7355f7d3fb0f9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:17.764594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347836c33a2549fab5b7355f7d3fb0f9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:17.765250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347836c33a2549fab5b7355f7d3fb0f9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:17.778783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1100/2188] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:17 2022] DELETE /identity/v3/users/347836c33a2549fab5b7355f7d3fb0f9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:17.783447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:17.783911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:17.784019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:17.802781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:17.803967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:17.862996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1089/2189] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:17.874842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:17.876380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:17.895842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:17.941032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfbbe3-a621-4413-ac13-62988213c31d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:17.946046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:17.946663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:17.946989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:17.947402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:17.958008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:17.959444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:17.968901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1101/2190] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:18.246473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:18.247951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:18.259828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573a29-3150-4e9c-b2d1-937e15ac930f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:18.264388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:18.265136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:18.265310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:18.265574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] PATH_INFO: `/v3/projects/81b12223e16f435cbccff20283524f10` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:18.266727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b12223e16f435cbccff20283524f10)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:18.268612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:18.315979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b12223e16f435cbccff20283524f10', 'request_id': 'req-b56e626e-5096-44f1-ac7a-81af96c63638'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.319597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:18.325423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b12223e16f435cbccff20283524f10', 'request_id': 'req-b56e626e-5096-44f1-ac7a-81af96c63638'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.333167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b12223e16f435cbccff20283524f10', 'request_id': 'req-b56e626e-5096-44f1-ac7a-81af96c63638'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.343461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] The token cache is being invalidate because project 81b12223e16f435cbccff20283524f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:18.343739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.344374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.346424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1090/2191] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:18 2022] DELETE /identity/v3/projects/81b12223e16f435cbccff20283524f10 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:18.350039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:18.359778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d41b9-b61a-4566-a7af-4c51fbd6e299 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:18.440652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:18.441280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:18.441551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:18.441813 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] PATH_INFO: `/v3/users/8b2fdaab1120478ead8f6c5e1a1969e0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:18.443006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2fdaab1120478ead8f6c5e1a1969e0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:18.444956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:18.492269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2fdaab1120478ead8f6c5e1a1969e0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.501694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2fdaab1120478ead8f6c5e1a1969e0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.515118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2fdaab1120478ead8f6c5e1a1969e0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.515825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2fdaab1120478ead8f6c5e1a1969e0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.516507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80a83763-a62d-4a14-83b6-e3a91400155c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2fdaab1120478ead8f6c5e1a1969e0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.529261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1102/2192] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:18 2022] DELETE /identity/v3/users/8b2fdaab1120478ead8f6c5e1a1969e0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:18.809058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:18.810609 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:18.825003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e626e-5096-44f1-ac7a-81af96c63638 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:18.885820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:18.886442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:18.886710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:18.886970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] PATH_INFO: `/v3/projects/84b22e6413f14b9992414379437a1009` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:18.888077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b22e6413f14b9992414379437a1009)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:18.890060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:18.941276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b22e6413f14b9992414379437a1009', 'request_id': 'req-aea25ed9-15f1-4f57-ba9f-80be2369115e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.950652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b22e6413f14b9992414379437a1009', 'request_id': 'req-aea25ed9-15f1-4f57-ba9f-80be2369115e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.957410 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b22e6413f14b9992414379437a1009', 'request_id': 'req-aea25ed9-15f1-4f57-ba9f-80be2369115e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.967977 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] The token cache is being invalidate because project 84b22e6413f14b9992414379437a1009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:18.968257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.968904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aea25ed9-15f1-4f57-ba9f-80be2369115e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:18.970496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1091/2193] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:18 2022] DELETE /identity/v3/projects/84b22e6413f14b9992414379437a1009 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:18.976661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:18.977196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:18.977294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:18.998563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:18.999769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:19.036964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:19.069307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1103/2194] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:19.078416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.078701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.078973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.100465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:19.101769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:19.111387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1092/2195] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:19.115905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.126675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2bff-54af-4153-ae85-860025a3c3e4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.131745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.132344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.132617 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.132881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.133667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:19.133965 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.135558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.147240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1104/2196] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:12:19.151943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.161578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780918ad-5ffa-486e-b279-ba3301f8d083 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.167563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.168157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.168415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.168686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.169355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.171376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.202411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1093/2197] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:19.206643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.218868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83661bde-36be-4f9c-8431-633d87555fca admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.288381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.289003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.289284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.289555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.290185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.292112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.314550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1105/2198] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:19.318678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.329922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a888f-34fd-4b4d-b214-ed3bccc355d1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.334456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.335031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.335303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.335570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.336241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.337944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.348941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1094/2199] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:19.352861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.363081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ff16b-9035-47f4-abd2-0cd533a02b85 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.368316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619d657-8944-401c-9349-fd8428d24c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.368917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619d657-8944-401c-9349-fd8428d24c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.369258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619d657-8944-401c-9349-fd8428d24c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.369527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619d657-8944-401c-9349-fd8428d24c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.370146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619d657-8944-401c-9349-fd8428d24c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.371755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619d657-8944-401c-9349-fd8428d24c4d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.384814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1106/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:19.397314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.408158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5c168-79ad-4820-92f9-0c240b5185eb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.412856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.413535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.413808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.414148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] PATH_INFO: `/v3/projects/6c8e2a1636444af39bde261c8f87e079/users/93a08035862843e294426b2ed96ba86c/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.428937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8e2a1636444af39bde261c8f87e079, user_id=93a08035862843e294426b2ed96ba86c, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.431684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.445519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1095/2201] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:19 2022] PUT /identity/v3/projects/6c8e2a1636444af39bde261c8f87e079/users/93a08035862843e294426b2ed96ba86c/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:19.456025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.456224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.456488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.485676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] MFA Rules not processed for user `93a08035862843e294426b2ed96ba86c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:19.486885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:19.565334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1107/2202] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:19.569798 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.582198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:19.641700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d172e-7f43-45f4-a01f-45f703451a91 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.646452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.647061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.647338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.647589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.648228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.650345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.679067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1096/2203] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:19.683209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.696268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe5b5-87fe-4468-91af-e899bf6a4ef5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.725294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:19.758707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.759338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.759678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.759953 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.760683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.762687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.798510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1108/2204] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:19.802327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.812939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60157e-de1b-4a42-b4a1-9f938922b7b7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.817548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.818291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.818567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.818844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.819598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.821204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.832075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1097/2205] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:19.836171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.846559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce0d3-f3d0-41dd-9772-b114ceeb381d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.851550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebe75f-74bb-4c1e-9fa7-4bf8b9ba8555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.852263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebe75f-74bb-4c1e-9fa7-4bf8b9ba8555 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.852541 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebe75f-74bb-4c1e-9fa7-4bf8b9ba8555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.852804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebe75f-74bb-4c1e-9fa7-4bf8b9ba8555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.853545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebe75f-74bb-4c1e-9fa7-4bf8b9ba8555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.855131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebe75f-74bb-4c1e-9fa7-4bf8b9ba8555 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.866319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1109/2206] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:19.870911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:19.881217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f789c-2d39-47b4-ae86-3f78fedf06b7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:19.885750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:19.886392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.886662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.886926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] PATH_INFO: `/v3/projects/a4b4f669872448c0b85d226a00af6839/users/6a16994ea14d42bf8b4482340c5aabfe/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.901431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b4f669872448c0b85d226a00af6839, user_id=6a16994ea14d42bf8b4482340c5aabfe, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:19.904188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:19.921180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1098/2207] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:19 2022] PUT /identity/v3/projects/a4b4f669872448c0b85d226a00af6839/users/6a16994ea14d42bf8b4482340c5aabfe/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:19.933886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:19.934233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:19.934580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:19.964199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] MFA Rules not processed for user `6a16994ea14d42bf8b4482340c5aabfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:19.965660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:20.041298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1110/2208] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:20.042486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.130680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247628fd-473c-45c8-b290-1a0466e4737c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.136371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.137151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.137293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.137719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.141388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.141388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.168640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1099/2209] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:20 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:20.172828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.185030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c675c-f372-4105-9cb6-9ae4846aec95 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.246171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.246698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.246976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.247241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.247870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.249837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.272157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1111/2210] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:20 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:20.276565 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.287100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2d02-df84-4c6b-9a80-a195d227127c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.292114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.292704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.292969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.293269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.293876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.295465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.306167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1100/2211] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:20.310318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.321458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf469b-279d-40dc-b19f-3c26be97a04c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.327181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.327829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.328118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.328385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] PATH_INFO: `/v3/projects/8b40cde17fb1441381e539f84501109a/users/f222a22091784e73897b273fd0375abc/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.343361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b40cde17fb1441381e539f84501109a, user_id=f222a22091784e73897b273fd0375abc, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.346098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.360847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1112/2212] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:20 2022] PUT /identity/v3/projects/8b40cde17fb1441381e539f84501109a/users/f222a22091784e73897b273fd0375abc/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:20.365103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.376193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedb28d-38aa-42b8-821b-4110d04b5133 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.408002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:20.435707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be479740-4d27-451a-8a5d-8202cfd50a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.436575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479740-4d27-451a-8a5d-8202cfd50a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.436927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479740-4d27-451a-8a5d-8202cfd50a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.437302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479740-4d27-451a-8a5d-8202cfd50a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.438311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be479740-4d27-451a-8a5d-8202cfd50a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.440739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be479740-4d27-451a-8a5d-8202cfd50a61 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.455699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1101/2213] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:20.460215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.475018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd5d4-117d-4caf-89d8-c3bd9ff169c8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.481440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.482090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.482358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.482717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] PATH_INFO: `/v3/projects/8b40cde17fb1441381e539f84501109a/users/f222a22091784e73897b273fd0375abc/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.484830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b40cde17fb1441381e539f84501109a, user_id=f222a22091784e73897b273fd0375abc, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.487499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.489773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:20.499828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1113/2214] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:20 2022] PUT /identity/v3/projects/8b40cde17fb1441381e539f84501109a/users/f222a22091784e73897b273fd0375abc/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:20.510112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.510396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.510663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.540222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] MFA Rules not processed for user `f222a22091784e73897b273fd0375abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:20.541542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:20.615254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1102/2215] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:20.628235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:20.630738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:20.703098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886b3f-e54b-4365-89af-335d00e9b7b8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:20.707286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:20.708006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:20.708396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:20.708667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:20.771865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:20.773238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:20.783015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1114/2216] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:22.311610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:22.321880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad4499-a662-4e98-a84d-d54a5071052b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:22.325980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:22.326131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:22.326402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:22.326644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:22.388324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:22.390013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:22.404885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1103/2217] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:23.030047 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:23.031589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:23.043000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fbaa-3cc7-40c5-a860-079cdc01697f service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:23.047100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4174d-2d1d-40ca-aa26-29d14277301a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:23.047730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4174d-2d1d-40ca-aa26-29d14277301a service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:23.048005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4174d-2d1d-40ca-aa26-29d14277301a service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:23.048271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4174d-2d1d-40ca-aa26-29d14277301a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:23.059373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4174d-2d1d-40ca-aa26-29d14277301a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:23.060870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4174d-2d1d-40ca-aa26-29d14277301a service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:23.072051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1115/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:12:26.995821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:27.047636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:27.059400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ee68-a5f9-4c59-b046-7f1511915981 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:27.063831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:27.064458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:27.064728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:27.065009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] PATH_INFO: `/v3/users/93a08035862843e294426b2ed96ba86c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:27.066147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a08035862843e294426b2ed96ba86c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:27.068071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:27.123323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a08035862843e294426b2ed96ba86c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.142286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a08035862843e294426b2ed96ba86c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.149175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a08035862843e294426b2ed96ba86c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.149925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a08035862843e294426b2ed96ba86c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.150576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a08035862843e294426b2ed96ba86c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.164372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1104/2219] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:26 2022] DELETE /identity/v3/users/93a08035862843e294426b2ed96ba86c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:27.168954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a399db-5f3b-42ac-a3f3-1dbd5ff7ff30 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:27.170771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a399db-5f3b-42ac-a3f3-1dbd5ff7ff30 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:27.171104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a399db-5f3b-42ac-a3f3-1dbd5ff7ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:27.191230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-59a399db-5f3b-42ac-a3f3-1dbd5ff7ff30 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:27.192431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-59a399db-5f3b-42ac-a3f3-1dbd5ff7ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:27.256894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1116/2220] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:27.267005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:27.268493 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:27.328347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadcfa5-84cd-4e75-83df-81e32be756bb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:27.332186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:27.332801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:27.333119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:27.333596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:27.344553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:27.346168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:27.357321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1105/2221] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:27.493478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:27.493785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:27.494050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:27.515189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] MFA Rules not processed for user `8256ead2715c4dd0809f856db9e9811b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:27.516340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:27.552709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:27.597598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1117/2222] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:27.769488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:27.771019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:27.784186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50a4df-33b5-4270-962a-da6874226226 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:27.788766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:27.789621 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:27.789908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:27.790173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] PATH_INFO: `/v3/projects/6c8e2a1636444af39bde261c8f87e079` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:27.791334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8e2a1636444af39bde261c8f87e079)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:27.793553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:27.873112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8e2a1636444af39bde261c8f87e079', 'request_id': 'req-76342056-5baf-4f87-983a-845d98e7dd94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.881470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8e2a1636444af39bde261c8f87e079', 'request_id': 'req-76342056-5baf-4f87-983a-845d98e7dd94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.890045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8e2a1636444af39bde261c8f87e079', 'request_id': 'req-76342056-5baf-4f87-983a-845d98e7dd94'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.899333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:27.903347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] The token cache is being invalidate because project 6c8e2a1636444af39bde261c8f87e079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:27.903872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.905052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:27.906750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1106/2223] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:27 2022] DELETE /identity/v3/projects/6c8e2a1636444af39bde261c8f87e079 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:27.911196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:27.924720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15937c-1e1b-40a2-b58c-335c410e0d6a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:28.008907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:28.010442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:28.010986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:28.011505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] PATH_INFO: `/v3/users/6a16994ea14d42bf8b4482340c5aabfe` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:28.016124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a16994ea14d42bf8b4482340c5aabfe)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:28.018328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:28.072834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a16994ea14d42bf8b4482340c5aabfe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.084714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a16994ea14d42bf8b4482340c5aabfe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.099350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a16994ea14d42bf8b4482340c5aabfe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.100638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a16994ea14d42bf8b4482340c5aabfe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.101511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a16994ea14d42bf8b4482340c5aabfe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.115265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1118/2224] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:27 2022] DELETE /identity/v3/users/6a16994ea14d42bf8b4482340c5aabfe => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:28.470860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:28.472437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:28.488559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76342056-5baf-4f87-983a-845d98e7dd94 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:28.551062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:28.552430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:28.553064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:28.553432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] PATH_INFO: `/v3/projects/a4b4f669872448c0b85d226a00af6839` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:28.554544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b4f669872448c0b85d226a00af6839)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:28.556433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:28.610034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b4f669872448c0b85d226a00af6839', 'request_id': 'req-c458d301-a91a-4159-b188-19de31cb2edd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.630640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b4f669872448c0b85d226a00af6839', 'request_id': 'req-c458d301-a91a-4159-b188-19de31cb2edd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.638824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b4f669872448c0b85d226a00af6839', 'request_id': 'req-c458d301-a91a-4159-b188-19de31cb2edd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.652035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] The token cache is being invalidate because project a4b4f669872448c0b85d226a00af6839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:28.652359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.653128 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.655135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1107/2225] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:28 2022] DELETE /identity/v3/projects/a4b4f669872448c0b85d226a00af6839 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:28.659203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:28.660835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:28.678694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c402e-c88e-44f1-b54e-1b82a827a9ab admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:28.779438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:28.780800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:28.781280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:28.781605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] PATH_INFO: `/v3/users/f222a22091784e73897b273fd0375abc` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:28.782774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f222a22091784e73897b273fd0375abc)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:28.784893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:28.789763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:28.863633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f222a22091784e73897b273fd0375abc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.872042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f222a22091784e73897b273fd0375abc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.889233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f222a22091784e73897b273fd0375abc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.890026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f222a22091784e73897b273fd0375abc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.890773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-733d6020-674a-440e-89e8-bc2771d9f208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f222a22091784e73897b273fd0375abc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:28.904605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1119/2226] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:28 2022] DELETE /identity/v3/users/f222a22091784e73897b273fd0375abc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:12:29.213817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.229739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:29.247226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d301-a91a-4159-b188-19de31cb2edd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.310420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.311173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.311514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.311849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] PATH_INFO: `/v3/projects/8b40cde17fb1441381e539f84501109a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.313242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b40cde17fb1441381e539f84501109a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.315316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.361164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:29.378591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b40cde17fb1441381e539f84501109a', 'request_id': 'req-c7ec69e1-2622-4890-9683-11df28c000ae'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:29.387221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b40cde17fb1441381e539f84501109a', 'request_id': 'req-c7ec69e1-2622-4890-9683-11df28c000ae'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:29.395271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b40cde17fb1441381e539f84501109a', 'request_id': 'req-c7ec69e1-2622-4890-9683-11df28c000ae'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:29.406422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] The token cache is being invalidate because project 8b40cde17fb1441381e539f84501109a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:29.406788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:29.407694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c7ec69e1-2622-4890-9683-11df28c000ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:29.409420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1108/2227] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:29 2022] DELETE /identity/v3/projects/8b40cde17fb1441381e539f84501109a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:29.415308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.415845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.416358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.445181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:29.446944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:29.533461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1120/2228] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:29.535809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.536944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.537495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.562304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:29.563959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:29.577276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1109/2229] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:29.578112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.603506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fbe10-b6fa-43a5-98cd-066cb5719a4b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.612664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.613482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.613749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.614139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.614793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:29.615090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.617035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.635035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1121/2230] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:12:29.639936 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.652150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc09db3-2fd4-4720-91ea-9a4f542d3578 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.676886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.676886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.677302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.677558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.678260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.680274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.727184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1110/2231] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:29 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:29.731504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.742120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770d85-98b0-4663-9051-5ac3b96c794c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.802527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.803066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.803342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.803633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.804235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.806306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.817299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:29.832117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1122/2232] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:29 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:29.836613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.848257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfe1cf-274f-4eb2-bc09-dcc6257f8f43 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.856651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.857319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.857596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.858319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.858490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.860165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.876425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1111/2233] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:29.880243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.891250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f40b-c2f9-4ce6-a7da-7ed00d19248c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.898537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bf96d-33a0-40ad-9930-8a5862f295fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.899497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bf96d-33a0-40ad-9930-8a5862f295fb admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.899497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bf96d-33a0-40ad-9930-8a5862f295fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.899984 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bf96d-33a0-40ad-9930-8a5862f295fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.900537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bf96d-33a0-40ad-9930-8a5862f295fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.902894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bf96d-33a0-40ad-9930-8a5862f295fb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.917194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1123/2234] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:29.918963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:29.936516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6ed9-f76c-43d9-91b7-9249cc00e34c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:29.941656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:29.942427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.942759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.943113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] PATH_INFO: `/v3/projects/68ab0ef7a44f48c3b62aba49743d1f8e/users/8025ccae0d3048e08b1b9e721321e0dd/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:29.962114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ab0ef7a44f48c3b62aba49743d1f8e, user_id=8025ccae0d3048e08b1b9e721321e0dd, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:29.965179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:29.983579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1112/2235] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:29 2022] PUT /identity/v3/projects/68ab0ef7a44f48c3b62aba49743d1f8e/users/8025ccae0d3048e08b1b9e721321e0dd/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:29.989338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6710e0-0099-4a60-a06c-36f1eddf033b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:29.989710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6710e0-0099-4a60-a06c-36f1eddf033b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:29.990044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6710e0-0099-4a60-a06c-36f1eddf033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:30.011463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fa6710e0-0099-4a60-a06c-36f1eddf033b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:30.012857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fa6710e0-0099-4a60-a06c-36f1eddf033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:30.091882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1124/2236] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:30.102248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:30.103989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:30.174083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16386-f00c-4b22-bb6b-8076cad7d3f7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:30.178486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:30.179120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:30.179703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:30.179703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:30.191101 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:30.192467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:30.203106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1113/2237] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:35.881023 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:35.881472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:35.881551 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:35.908463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:35.910732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:35.926399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39188c9-b73a-43e7-b1ea-6177c9453abb service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:35.932481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:35.933467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:35.933917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:35.934378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] PATH_INFO: `/v3/users/48188a0cc131445fbd706c9c3583d08d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:35.935733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48188a0cc131445fbd706c9c3583d08d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:35.938217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:35.970753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] MFA Rules not processed for user `8025ccae0d3048e08b1b9e721321e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:35.973241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:36.040199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48188a0cc131445fbd706c9c3583d08d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:36.051989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:36.068298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48188a0cc131445fbd706c9c3583d08d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:36.092025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48188a0cc131445fbd706c9c3583d08d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:36.092025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48188a0cc131445fbd706c9c3583d08d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:36.092025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c473c3c-3d98-457a-af44-6816c8189d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48188a0cc131445fbd706c9c3583d08d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:36.107100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1114/2238] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:12:35 2022] DELETE /identity/v3/users/48188a0cc131445fbd706c9c3583d08d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:36.111599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.111888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.112007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1125/2239] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:36.112244 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.115873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.119463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:36.141470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ef62-1578-461e-b5ec-45e6d2f0046f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.164720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:36.166041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:36.219697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.220505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.220867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.221262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.222078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.224662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.251513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1115/2240] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:12:36.256784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:36.262440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.264457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:36.272106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1126/2241] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:36 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:36.275958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.386598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf83f-8d6e-47ae-ac6f-4d3c3203dd01 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.394345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.395146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.395468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.395795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.396552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.398607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.399651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fc13b-c830-4071-8fcc-a0240f985e7a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.434605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1127/2242] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:36 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:36.435991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.459846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db1f63-7952-49f7-b0ac-5f6c1bf0a6eb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.473244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.474165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.474506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.474841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.475744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.477667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.494030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1128/2243] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:36.495606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.511605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.512445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.512728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.513019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.516480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd425-6acf-4339-95cf-d870b5d8a623 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.521271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.522560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.522842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.523114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] PATH_INFO: `/v3/projects/16cdb724b6194a4ba5361917a9233f59/users/0e72db61678344b6921baaebba941f5f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.524592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.526270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.537293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1116/2244] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:36.540606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cdb724b6194a4ba5361917a9233f59, user_id=0e72db61678344b6921baaebba941f5f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.543410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.561033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1129/2245] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:36 2022] PUT /identity/v3/projects/16cdb724b6194a4ba5361917a9233f59/users/0e72db61678344b6921baaebba941f5f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:36.563549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.578518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0998e-186a-4cad-bab8-1e93ae548640 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.610083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:36.657994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.658693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.659030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.659395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.660046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.661773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.678146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1117/2246] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:36.682045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:36.700750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3449-b421-48f8-8018-34d5b58e8ecf admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:36.708589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f6367-f3c4-4dbe-b9f2-63319e7019a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:36.709356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f6367-f3c4-4dbe-b9f2-63319e7019a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:36.709730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f6367-f3c4-4dbe-b9f2-63319e7019a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:36.710106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f6367-f3c4-4dbe-b9f2-63319e7019a6 admin admin] PATH_INFO: `/v3/projects/16cdb724b6194a4ba5361917a9233f59/users/0e72db61678344b6921baaebba941f5f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:36.713276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f6367-f3c4-4dbe-b9f2-63319e7019a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cdb724b6194a4ba5361917a9233f59, user_id=0e72db61678344b6921baaebba941f5f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:36.716324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f6367-f3c4-4dbe-b9f2-63319e7019a6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:36.740418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1130/2247] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:36 2022] PUT /identity/v3/projects/16cdb724b6194a4ba5361917a9233f59/users/0e72db61678344b6921baaebba941f5f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:37.015354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.017678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:37.032149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cc78b-14b7-4054-aa2c-08db62f14e15 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.108916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.109825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.109955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.110335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] PATH_INFO: `/v3/projects/0b9aaa1fa4ee4f32a8e67071e337d35d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.111484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9aaa1fa4ee4f32a8e67071e337d35d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.119594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.188694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9aaa1fa4ee4f32a8e67071e337d35d', 'request_id': 'req-aeee94ee-2686-4be8-8eaf-670527f55d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:37.203036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9aaa1fa4ee4f32a8e67071e337d35d', 'request_id': 'req-aeee94ee-2686-4be8-8eaf-670527f55d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:37.215166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9aaa1fa4ee4f32a8e67071e337d35d', 'request_id': 'req-aeee94ee-2686-4be8-8eaf-670527f55d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:37.231533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] The token cache is being invalidate because project 0b9aaa1fa4ee4f32a8e67071e337d35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:12:37.231844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:37.232680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-aeee94ee-2686-4be8-8eaf-670527f55d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:12:37.238453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1118/2248] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:12:37 2022] DELETE /identity/v3/projects/0b9aaa1fa4ee4f32a8e67071e337d35d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:37.239821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.240277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.240456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.275228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:37.276601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:37.373140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1131/2249] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:37.379294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.379582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.379854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.417854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:37.419347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:37.432700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1119/2250] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:37.433943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.444782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f2ff-ed9d-4503-9038-8d31434942a6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.450097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.450757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.451094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.451431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.452180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:12:37.452604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.454334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.469383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1132/2251] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:12:37.473836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.483889 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812a81-d4d7-421d-9c38-a06c0c5cfd23 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.493319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.493955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.494227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.494547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.495190 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.497845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.542274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.547909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1120/2252] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:12:37 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:12:37.558050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2dc7-1641-40b6-a4f3-5739b3263c36 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.591852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:37.632556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.633397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.633747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.634083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.634937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.637486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.673446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1133/2253] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:12:37 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:12:37.677620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.688530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0de06-3ed6-4d78-9e74-f25e0f4145a4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.693713 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.694469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.695217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.695217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.695794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.697732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.713120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.714196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1121/2254] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:12:37.723949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9f08b-eb98-466f-8846-a663fae2738d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.730060 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4d9b7-aeef-45cf-a927-8f0e815c559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.731343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4d9b7-aeef-45cf-a927-8f0e815c559d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.731988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4d9b7-aeef-45cf-a927-8f0e815c559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.732265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4d9b7-aeef-45cf-a927-8f0e815c559d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.733020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4d9b7-aeef-45cf-a927-8f0e815c559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.735115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4d9b7-aeef-45cf-a927-8f0e815c559d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.760999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:37.769054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1134/2255] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:12:37.775269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222f8a-8642-424e-95b3-c51c340c5ce2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:37.780865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:37.781832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.782051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.782327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] PATH_INFO: `/v3/projects/0416faddb13e45879c80ba4d6382b4a0/users/941c4f9cf7c94b7ca0b85bfd036ccae1/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.798366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:37.805864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0416faddb13e45879c80ba4d6382b4a0, user_id=941c4f9cf7c94b7ca0b85bfd036ccae1, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:37.809670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:37.840943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1122/2256] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:12:37 2022] PUT /identity/v3/projects/0416faddb13e45879c80ba4d6382b4a0/users/941c4f9cf7c94b7ca0b85bfd036ccae1/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:12:37.852288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2134ff-26ee-49bf-8462-6eb053f9dbe7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:37.852602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2134ff-26ee-49bf-8462-6eb053f9dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:37.853100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2134ff-26ee-49bf-8462-6eb053f9dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:37.886860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6a2134ff-26ee-49bf-8462-6eb053f9dbe7 None None] MFA Rules not processed for user `941c4f9cf7c94b7ca0b85bfd036ccae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:37.888325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6a2134ff-26ee-49bf-8462-6eb053f9dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:38.002560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1135/2257] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:38.013529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:38.015363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:38.098740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2c97-ab76-4a34-b1bb-e7d2081f0d65 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:38.103602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ed883-f89b-4a8e-b66a-dff74cbb4fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:38.104316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ed883-f89b-4a8e-b66a-dff74cbb4fea service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:38.104856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ed883-f89b-4a8e-b66a-dff74cbb4fea service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:38.105372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ed883-f89b-4a8e-b66a-dff74cbb4fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:38.131079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ed883-f89b-4a8e-b66a-dff74cbb4fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:38.134057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ed883-f89b-4a8e-b66a-dff74cbb4fea service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:38.152489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1123/2258] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:39.747665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24297600-d054-4f24-857e-e45d3649f177 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:39.748240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24297600-d054-4f24-857e-e45d3649f177 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:39.748240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24297600-d054-4f24-857e-e45d3649f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:39.773200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-24297600-d054-4f24-857e-e45d3649f177 None None] MFA Rules not processed for user `941c4f9cf7c94b7ca0b85bfd036ccae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:39.774704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-24297600-d054-4f24-857e-e45d3649f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:39.787258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1136/2259] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:44.506804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d6ab9-5c73-42ce-9f5a-f83b14b8a491 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:44.507337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d6ab9-5c73-42ce-9f5a-f83b14b8a491 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:44.507526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d6ab9-5c73-42ce-9f5a-f83b14b8a491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:44.538610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ba2d6ab9-5c73-42ce-9f5a-f83b14b8a491 None None] MFA Rules not processed for user `0e72db61678344b6921baaebba941f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:44.540132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ba2d6ab9-5c73-42ce-9f5a-f83b14b8a491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:44.654953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1124/2260] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:44.735406 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24297600-d054-4f24-857e-e45d3649f177 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:44.737137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-24297600-d054-4f24-857e-e45d3649f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:44.832533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24297600-d054-4f24-857e-e45d3649f177 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:44.838861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:44.839509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:44.839861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:44.840081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:44.841892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:44.890873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:44.930956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:44.938746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290dfec-5e9b-4e2c-9c00-71ea7c36a564 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:44.962068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1137/2261] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:12:47.092016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf613b-b96e-45b2-b5ad-b8b1f989d051 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:47.092572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf613b-b96e-45b2-b5ad-b8b1f989d051 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:47.092661 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf613b-b96e-45b2-b5ad-b8b1f989d051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:47.113725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-78cf613b-b96e-45b2-b5ad-b8b1f989d051 None None] MFA Rules not processed for user `8025ccae0d3048e08b1b9e721321e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:47.114979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-78cf613b-b96e-45b2-b5ad-b8b1f989d051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:47.124808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1125/2262] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:50.791205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:50.791969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:50.791969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:50.834498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] MFA Rules not processed for user `7998d31e0b6a4bf9be7b2c7e4005c547`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:50.835791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:50.948682 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1138/2263] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:51.808841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fd0c1-ce3d-46fa-bd90-f5d9a1df3490 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:51.809402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fd0c1-ce3d-46fa-bd90-f5d9a1df3490 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:51.809402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fd0c1-ce3d-46fa-bd90-f5d9a1df3490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:51.828942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-860fd0c1-ce3d-46fa-bd90-f5d9a1df3490 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:12:51.830339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-860fd0c1-ce3d-46fa-bd90-f5d9a1df3490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:51.893743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1126/2264] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:12:51.946844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:12:51.949919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:12:52.055431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a658277-fa72-4fa9-a97a-1669803e255a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:12:52.061462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:12:52.062077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:12:52.062348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:12:52.062613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:12:52.071261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:12:52.072911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:12:52.082051 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1139/2265] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:01.892549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:02.078487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=72 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:02.174832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabfc-d387-427d-af12-10a3c52a29e1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:02.175169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabfc-d387-427d-af12-10a3c52a29e1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:02.175444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabfc-d387-427d-af12-10a3c52a29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:02.195235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-04dcabfc-d387-427d-af12-10a3c52a29e1 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:02.196462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-04dcabfc-d387-427d-af12-10a3c52a29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:02.203767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1127/2266] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:02.216877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:02.228429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ab11-b6f9-47fd-a140-27f313399254 service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:02.233379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:02.233989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:02.234248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:02.234510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:02.243069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:02.244649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:02.260397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1140/2267] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:02.788668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f3b15-01e0-4c22-b2ba-0760acf5c7aa None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:02.788970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f3b15-01e0-4c22-b2ba-0760acf5c7aa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:02.789275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f3b15-01e0-4c22-b2ba-0760acf5c7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:02.808321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eb7f3b15-01e0-4c22-b2ba-0760acf5c7aa None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:02.809533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eb7f3b15-01e0-4c22-b2ba-0760acf5c7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:02.818075 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1128/2268] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 10 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:02.831619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:02.843073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48702-470c-4314-bc9e-e0b76845d449 service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:02.848307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:02.848914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:02.849225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:02.849507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:02.858501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:02.860505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:02.872860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1141/2269] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:03.133509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc10b-1aad-43aa-bbc7-2cf9b6fb1663 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:03.134009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc10b-1aad-43aa-bbc7-2cf9b6fb1663 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:03.134360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc10b-1aad-43aa-bbc7-2cf9b6fb1663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:03.154125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f30fc10b-1aad-43aa-bbc7-2cf9b6fb1663 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:03.155443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f30fc10b-1aad-43aa-bbc7-2cf9b6fb1663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:03.162589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1129/2270] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:03.175137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:03.185789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781c8b-1436-414a-98eb-ccc169639712 service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:03.190658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:03.191250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:03.191518 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:03.191785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:03.202052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:03.203701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:03.216433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1142/2271] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:03.603033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:03.603311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:03.603571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:03.622710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:03.623935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:03.632294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1130/2272] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 10 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:03.646792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:03.657735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc429-31fe-43e6-8b55-f34ef8b1531e service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:03.663186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aafe5-93e4-46ae-b23e-9f11eb6e9479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:03.663946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aafe5-93e4-46ae-b23e-9f11eb6e9479 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:03.664211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aafe5-93e4-46ae-b23e-9f11eb6e9479 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:03.664472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aafe5-93e4-46ae-b23e-9f11eb6e9479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:03.672928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048aafe5-93e4-46ae-b23e-9f11eb6e9479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:03.674538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048aafe5-93e4-46ae-b23e-9f11eb6e9479 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:03.682958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1143/2273] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:05.876265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:05.942666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a5705-c234-4789-a438-d3c0c3eb5882 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:05.949193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:05.949801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:05.950073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:05.950338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] PATH_INFO: `/v3/users/941c4f9cf7c94b7ca0b85bfd036ccae1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:05.951456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941c4f9cf7c94b7ca0b85bfd036ccae1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:05.953406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.003167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941c4f9cf7c94b7ca0b85bfd036ccae1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.015002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941c4f9cf7c94b7ca0b85bfd036ccae1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.021892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941c4f9cf7c94b7ca0b85bfd036ccae1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.022573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941c4f9cf7c94b7ca0b85bfd036ccae1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.023186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941c4f9cf7c94b7ca0b85bfd036ccae1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.037689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1131/2274] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:13:05 2022] DELETE /identity/v3/users/941c4f9cf7c94b7ca0b85bfd036ccae1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:13:06.042221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.042782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.042879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.062010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:06.063209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:06.142063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1144/2275] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:06.168295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.169822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:06.229161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81373c-8d67-4b2e-98db-a4e572e18a94 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.232790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6c684-a5b0-4f26-8d12-7237a807eb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.233435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c684-a5b0-4f26-8d12-7237a807eb06 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.233720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c684-a5b0-4f26-8d12-7237a807eb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.233979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c684-a5b0-4f26-8d12-7237a807eb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.242657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:06.245616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6c684-a5b0-4f26-8d12-7237a807eb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.247574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6c684-a5b0-4f26-8d12-7237a807eb06 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.266990 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1132/2276] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:13:06.459287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.460858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:06.473717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8a0b4-c00b-449a-8b94-44fb1c7e57b8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.478836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.479570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.480112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.480440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] PATH_INFO: `/v3/projects/0416faddb13e45879c80ba4d6382b4a0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.481663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0416faddb13e45879c80ba4d6382b4a0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.483881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.535568 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0416faddb13e45879c80ba4d6382b4a0', 'request_id': 'req-f6285cd1-1012-4abe-99e8-2228cb170ccb'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.542044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0416faddb13e45879c80ba4d6382b4a0', 'request_id': 'req-f6285cd1-1012-4abe-99e8-2228cb170ccb'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.550314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0416faddb13e45879c80ba4d6382b4a0', 'request_id': 'req-f6285cd1-1012-4abe-99e8-2228cb170ccb'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.561289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] The token cache is being invalidate because project 0416faddb13e45879c80ba4d6382b4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:13:06.561559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.562167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f6285cd1-1012-4abe-99e8-2228cb170ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:13:06.568350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1145/2277] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:13:06 2022] DELETE /identity/v3/projects/0416faddb13e45879c80ba4d6382b4a0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:13:06.570183 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.570523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.570885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.594201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:06.595556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:06.670077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1133/2278] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:06.679374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.680021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.682073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.704865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:06.706195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:06.717131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1146/2279] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:06.719459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.730456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682fed-fcfc-46da-9d8f-93c006e74221 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.736425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.736425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.736878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.737240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.737953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:13:06.738435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.740270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.757331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1134/2280] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:13:06.758272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.767866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26509ba-c579-404b-91cb-ad81f13e87b3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.773306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.773940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.774212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.774476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.775129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.777155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.805280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1147/2281] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:13:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:13:06.809531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.819321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf6a72-7e43-4c9a-ade9-8db98dfd0f4d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.878342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.878985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.879202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.879470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.880094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.882097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.908851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1135/2282] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:13:06 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:13:06.910344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.916070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:06.923204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0be7af-2eff-4fa3-9dee-a4152b5530d2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.929309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.930143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.930581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.931054 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.931835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.933562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.947092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1148/2283] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:13:06.948363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.958727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19299-0b5a-4ee4-9010-df0318467e3b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.963755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e59cd4-bef2-4279-b61d-0b2690e56da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.964378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59cd4-bef2-4279-b61d-0b2690e56da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.964655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59cd4-bef2-4279-b61d-0b2690e56da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.965069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59cd4-bef2-4279-b61d-0b2690e56da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:06.965749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e59cd4-bef2-4279-b61d-0b2690e56da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:06.967326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e59cd4-bef2-4279-b61d-0b2690e56da6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:06.978567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1136/2284] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:13:06.983243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:06.993934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683a66-0fbb-4557-9711-c1fe17db726b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:06.998629 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:06.999271 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:06.999552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:06.999819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] PATH_INFO: `/v3/projects/04a34bfad4984b52bacd6b3a0941091a/users/9f23fbce0dfc493a819ff266b5c2ff22/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:07.016350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a34bfad4984b52bacd6b3a0941091a, user_id=9f23fbce0dfc493a819ff266b5c2ff22, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:07.019052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:07.035101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1149/2285] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:13:06 2022] PUT /identity/v3/projects/04a34bfad4984b52bacd6b3a0941091a/users/9f23fbce0dfc493a819ff266b5c2ff22/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:13:07.040214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4b2e8-e740-4107-9c9f-a1c739dbe296 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:07.040495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4b2e8-e740-4107-9c9f-a1c739dbe296 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:07.040763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4b2e8-e740-4107-9c9f-a1c739dbe296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:07.059908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-02b4b2e8-e740-4107-9c9f-a1c739dbe296 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:07.061120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-02b4b2e8-e740-4107-9c9f-a1c739dbe296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:07.122824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1137/2286] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:07.132669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:07.134564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:07.215034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639a17e-3040-498d-82c8-cc78fa3f584f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:07.221768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f569f-9a65-4dff-93c6-d0707c559d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:07.222850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f569f-9a65-4dff-93c6-d0707c559d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:07.223374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f569f-9a65-4dff-93c6-d0707c559d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:07.223734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f569f-9a65-4dff-93c6-d0707c559d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:07.244073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f569f-9a65-4dff-93c6-d0707c559d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:07.246211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f569f-9a65-4dff-93c6-d0707c559d99 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:07.257930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1150/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:07.757131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68a7e-6d89-4077-ae33-f78697eb7cbe None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:07.757327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68a7e-6d89-4077-ae33-f78697eb7cbe None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:07.757607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68a7e-6d89-4077-ae33-f78697eb7cbe None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:07.759012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1138/2288] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:13:07.769124 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30a47-b45a-4392-8c1f-fd14103438cf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:07.769406 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30a47-b45a-4392-8c1f-fd14103438cf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:07.769898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30a47-b45a-4392-8c1f-fd14103438cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:07.790688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9bc30a47-b45a-4392-8c1f-fd14103438cf None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:07.791882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9bc30a47-b45a-4392-8c1f-fd14103438cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:07.865675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1151/2289] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:07.877510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68a7e-6d89-4077-ae33-f78697eb7cbe None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:07.879219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e9d68a7e-6d89-4077-ae33-f78697eb7cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:07.885274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:07.942919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68a7e-6d89-4077-ae33-f78697eb7cbe None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:07.947114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d64b4-8207-40b1-9799-4cf595242891 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:07.947294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d64b4-8207-40b1-9799-4cf595242891 service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:07.947556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d64b4-8207-40b1-9799-4cf595242891 service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:07.947842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d64b4-8207-40b1-9799-4cf595242891 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:07.960053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d64b4-8207-40b1-9799-4cf595242891 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:07.961197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d64b4-8207-40b1-9799-4cf595242891 service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:07.973090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1139/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:08.054152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8693-3b08-4a68-9cb2-558ff4a01caa None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:08.054432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8693-3b08-4a68-9cb2-558ff4a01caa None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:08.054731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8693-3b08-4a68-9cb2-558ff4a01caa None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:08.056279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1152/2291] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:13:08.071333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793315-9ea4-4cab-8da6-e2a1583b7501 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:08.071609 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793315-9ea4-4cab-8da6-e2a1583b7501 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:08.080481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793315-9ea4-4cab-8da6-e2a1583b7501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:08.144365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-15793315-9ea4-4cab-8da6-e2a1583b7501 None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:08.147143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-15793315-9ea4-4cab-8da6-e2a1583b7501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:08.160442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1140/2292] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:08.181985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8693-3b08-4a68-9cb2-558ff4a01caa None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:08.210029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8693-3b08-4a68-9cb2-558ff4a01caa None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:08.223335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4618d99-fe95-424a-aef6-75fac4796259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:08.224039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618d99-fe95-424a-aef6-75fac4796259 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:08.224319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618d99-fe95-424a-aef6-75fac4796259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:08.224639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618d99-fe95-424a-aef6-75fac4796259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:08.236591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4618d99-fe95-424a-aef6-75fac4796259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:08.238397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4618d99-fe95-424a-aef6-75fac4796259 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:08.297924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1153/2293] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:08.419272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6cc65-2ef8-40e8-8018-32a5b27f0a7b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:08.419554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6cc65-2ef8-40e8-8018-32a5b27f0a7b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:08.425635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6cc65-2ef8-40e8-8018-32a5b27f0a7b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:08.427508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1141/2294] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:13:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:13:08.437150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8df8f2-336d-448e-a812-17bac53b8f2e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:08.437473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8df8f2-336d-448e-a812-17bac53b8f2e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:08.438230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8df8f2-336d-448e-a812-17bac53b8f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:08.480638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7d8df8f2-336d-448e-a812-17bac53b8f2e None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:08.481944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7d8df8f2-336d-448e-a812-17bac53b8f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:08.493929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1154/2295] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:13:08.506597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6cc65-2ef8-40e8-8018-32a5b27f0a7b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:08.508582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d5e6cc65-2ef8-40e8-8018-32a5b27f0a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:08.527794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6cc65-2ef8-40e8-8018-32a5b27f0a7b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:08.533121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:08.533948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:08.534395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:08.534904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:08.560419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:08.562898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:08.588412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1142/2296] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:13.886524 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255f0-2224-4dd8-9ab6-79843577ac8e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:13.887392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255f0-2224-4dd8-9ab6-79843577ac8e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:13.887660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255f0-2224-4dd8-9ab6-79843577ac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:13.910268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-666255f0-2224-4dd8-9ab6-79843577ac8e None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:13.912065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-666255f0-2224-4dd8-9ab6-79843577ac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:13.957658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:13.976371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1155/2297] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:13.990352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:13.991833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:14.070968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016ba46-30e0-4695-8052-9bfc760a1927 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:14.078019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:14.078308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:14.078464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:14.078872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:14.088671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:14.090844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:14.099449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1143/2298] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:14.941710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:14.942231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:14.942453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:14.982290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] MFA Rules not processed for user `9f23fbce0dfc493a819ff266b5c2ff22`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:14.984086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:15.129563 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1156/2299] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:15.134000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:15.151128 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f131f-92f9-4067-adbe-2e3f2bd822fc service swift] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:15.157054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:15.158995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:15.159720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:15.160704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:15.161821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:15.165433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:15.221741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1144/2300] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:13:15 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:13:15.223795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:15.242330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498c343-e9f1-45ba-b23f-4dbb44810895 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:15.374558 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:15.375265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:15.375698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:15.375971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:15.376614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:15.382109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:15.432578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1157/2301] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:13:15 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:13:15.437942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:15.459503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74496b74-5cdc-4b13-bb41-361028450afa admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:15.473033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:15.473771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:15.474084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:15.474437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:15.475163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:15.478969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:15.506003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1145/2302] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:13:15.510321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:15.534193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5f077-cbae-4784-8f20-d3f1264dbaca admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:15.547997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:15.548844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:15.549276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:15.550403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] PATH_INFO: `/v3/projects/814dc85ef69e4921bc7c9361eba0e1a8/users/c9ff053497c64d5eaa78de7dee687f7f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:15.570535 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814dc85ef69e4921bc7c9361eba0e1a8, user_id=c9ff053497c64d5eaa78de7dee687f7f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:15.573871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:15.595182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1158/2303] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:13:15 2022] PUT /identity/v3/projects/814dc85ef69e4921bc7c9361eba0e1a8/users/c9ff053497c64d5eaa78de7dee687f7f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:13:15.599538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:15.614237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73625f5-e1ad-4398-9aa4-5db8b1411489 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:15.731374 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:15.762149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7deeb5-33a7-4fb4-9a7e-fc50321230f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:15.762771 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7deeb5-33a7-4fb4-9a7e-fc50321230f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:15.763045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7deeb5-33a7-4fb4-9a7e-fc50321230f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:15.763314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7deeb5-33a7-4fb4-9a7e-fc50321230f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:15.763961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7deeb5-33a7-4fb4-9a7e-fc50321230f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:15.765601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7deeb5-33a7-4fb4-9a7e-fc50321230f9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:15.783476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1146/2304] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:13:15.787491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:15.805687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af52bd9-4599-4b07-8a0b-5d220a299489 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:15.818897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:15.819582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:15.819851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:15.820236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] PATH_INFO: `/v3/projects/814dc85ef69e4921bc7c9361eba0e1a8/users/c9ff053497c64d5eaa78de7dee687f7f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:15.822240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=814dc85ef69e4921bc7c9361eba0e1a8, user_id=c9ff053497c64d5eaa78de7dee687f7f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:15.825019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:15.851838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1159/2305] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:13:15 2022] PUT /identity/v3/projects/814dc85ef69e4921bc7c9361eba0e1a8/users/c9ff053497c64d5eaa78de7dee687f7f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:13:22.627755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2b61-7a42-42f3-a827-723cb94c3a04 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:22.628371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2b61-7a42-42f3-a827-723cb94c3a04 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:22.628371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2b61-7a42-42f3-a827-723cb94c3a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:22.685921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8bfa2b61-7a42-42f3-a827-723cb94c3a04 None None] MFA Rules not processed for user `c9ff053497c64d5eaa78de7dee687f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:22.687380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8bfa2b61-7a42-42f3-a827-723cb94c3a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:22.828780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1147/2306] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:22.839249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:22.875705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:22.918547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2940-db06-4e34-84ac-95098e92da0f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:22.922539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:22.922956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:22.923223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:22.923509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:22.997480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:22.999072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:23.010875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1160/2307] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:23.170895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:23.170895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:23.170895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:23.223365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:23.224600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:23.298060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1148/2308] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:13:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:23.319250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:23.389090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b1438-8439-44e3-a06c-7ecc82af0a49 service glance] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:23.394239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d0f8-3e9e-474c-a936-86e0a77fe6e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:23.394881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d0f8-3e9e-474c-a936-86e0a77fe6e0 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:23.395181 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d0f8-3e9e-474c-a936-86e0a77fe6e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:23.395469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d0f8-3e9e-474c-a936-86e0a77fe6e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:23.404907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d0f8-3e9e-474c-a936-86e0a77fe6e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:23.406562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d0f8-3e9e-474c-a936-86e0a77fe6e0 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:23.416640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1161/2309] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:30.562338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:30.635905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbd6-edef-4849-9e61-6fa9cb6cc2e0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:30.639938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:30.640666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:30.641072 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:30.641439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:30.643308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:30.673149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:30.727219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:30.731460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecd295-6b74-4338-9183-2587e669024c service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:30.743894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1149/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:32.872119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:32.872782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:32.872782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:32.896562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] MFA Rules not processed for user `9f23fbce0dfc493a819ff266b5c2ff22`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:32.906294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:32.914097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1162/2311] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:13:34.127678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aff5a3-7bdd-4aa7-9269-2fc4a2bb10eb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:34.128296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aff5a3-7bdd-4aa7-9269-2fc4a2bb10eb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:34.128296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aff5a3-7bdd-4aa7-9269-2fc4a2bb10eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:34.149931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a2aff5a3-7bdd-4aa7-9269-2fc4a2bb10eb None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:34.151123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a2aff5a3-7bdd-4aa7-9269-2fc4a2bb10eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:34.158719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1150/2312] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 10 11:13:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:34.172210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:34.187578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491df2-1449-43ea-b018-ddc8c57e4564 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:34.196004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:34.197681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:34.197975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:34.198467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:34.209610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:34.211253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:34.221846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1163/2313] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:35.732339 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:35.732820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:35.732913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:35.756718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:35.758378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:35.768369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1151/2314] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:13:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:13:35.786166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:35.797517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f402-cc79-460e-8520-6e63f84a8e00 service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:35.803514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911986ae-8cca-4c24-86d6-f6dcf09c9045 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:35.804127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911986ae-8cca-4c24-86d6-f6dcf09c9045 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:35.804401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911986ae-8cca-4c24-86d6-f6dcf09c9045 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:35.804660 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911986ae-8cca-4c24-86d6-f6dcf09c9045 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:35.813855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911986ae-8cca-4c24-86d6-f6dcf09c9045 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:35.815544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911986ae-8cca-4c24-86d6-f6dcf09c9045 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:35.825308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1164/2315] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:13:45.750951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=25 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:45.821490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=82 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:46.013825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:13:46.015596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:46.094417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca1337-d740-413c-ba00-31e37d27f95f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:13:46.100279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:13:46.100968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:46.101300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:46.101564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:46.103381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:46.130164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:13:46.131803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:13:46.143120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1152/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:13:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:13:56.139783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=32 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:57.236610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955e23-9133-4434-a70d-710f9e2d4232 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:13:57.237164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955e23-9133-4434-a70d-710f9e2d4232 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:13:57.237280 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955e23-9133-4434-a70d-710f9e2d4232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:13:57.257380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a2955e23-9133-4434-a70d-710f9e2d4232 None None] MFA Rules not processed for user `8256ead2715c4dd0809f856db9e9811b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:13:57.258579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a2955e23-9133-4434-a70d-710f9e2d4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:13:57.314196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1165/2317] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:00.389689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:00.399567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a548c-aa6d-4fc2-ab83-3883742d7077 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:00.403849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e139b-507d-4659-94c7-0af1d82116b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:00.404449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e139b-507d-4659-94c7-0af1d82116b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:00.404720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e139b-507d-4659-94c7-0af1d82116b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:00.405005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e139b-507d-4659-94c7-0af1d82116b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:00.414322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e139b-507d-4659-94c7-0af1d82116b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:00.415749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e139b-507d-4659-94c7-0af1d82116b6 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:00.427475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1153/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:07.306992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=25 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:10.421077 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:25.598077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1bf7b-f8d0-4f9a-b7c6-bd0bf3a06ebb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:25.598650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1bf7b-f8d0-4f9a-b7c6-bd0bf3a06ebb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:25.598650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1bf7b-f8d0-4f9a-b7c6-bd0bf3a06ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:25.617975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0cc1bf7b-f8d0-4f9a-b7c6-bd0bf3a06ebb None None] MFA Rules not processed for user `d01d3fdea0f9451e8301003c34734569`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:25.619158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0cc1bf7b-f8d0-4f9a-b7c6-bd0bf3a06ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:25.674455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1166/2319] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:27.376531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8f69d-b16c-4e19-a118-732ff09eeca4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:27.377083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8f69d-b16c-4e19-a118-732ff09eeca4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:27.377206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8f69d-b16c-4e19-a118-732ff09eeca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:27.401849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c8c8f69d-b16c-4e19-a118-732ff09eeca4 None None] MFA Rules not processed for user `7998d31e0b6a4bf9be7b2c7e4005c547`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:27.401849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c8c8f69d-b16c-4e19-a118-732ff09eeca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:27.466902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1154/2320] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:14:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:35.667691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=25 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:37.460356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=25 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:07.735338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:07.735883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:07.735883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:07.755311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] MFA Rules not processed for user `8256ead2715c4dd0809f856db9e9811b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:07.756493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:07.764368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1167/2321] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:17.749851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:25.968727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:25.969682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:25.970105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:25.992453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] MFA Rules not processed for user `95398f8ac1ca42c0969b37f54a582e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:25.993779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:26.065181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1155/2322] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:32.480709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:32.491450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f81b1-8230-43e5-bc19-db0135616697 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:32.495381 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:32.495969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:32.496239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:32.496500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:32.498385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:32.568996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:32.570471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:32.581290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1168/2323] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:34.572803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:34.574817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.631280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda086-6538-41c9-9ccb-3b5f2349fc24 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:34.634991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:34.635591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:34.635861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:34.636121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:34.638007 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.651431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:34.652849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:34.663843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1156/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:37.908154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:37.916727 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056a33d-2aa0-4edf-9cf0-29984a607fd8 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:37.920500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:37.921153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:37.921430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:37.921694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:37.923367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:37.991662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:37.993121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:38.003307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1169/2325] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:41.981236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:41.982892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:41.997238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fed249-399e-4d55-aab2-d7969a2594a5 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.002668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.003293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.003571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.003789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] PATH_INFO: `/v3/users/7998d31e0b6a4bf9be7b2c7e4005c547` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.004931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7998d31e0b6a4bf9be7b2c7e4005c547)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.006879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.057633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7998d31e0b6a4bf9be7b2c7e4005c547'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.069225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7998d31e0b6a4bf9be7b2c7e4005c547'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.075867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7998d31e0b6a4bf9be7b2c7e4005c547'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.076519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7998d31e0b6a4bf9be7b2c7e4005c547'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.077152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1796bd92-d42e-4960-bd24-7cea592e895a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7998d31e0b6a4bf9be7b2c7e4005c547'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.090037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1157/2326] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:15:41 2022] DELETE /identity/v3/users/7998d31e0b6a4bf9be7b2c7e4005c547 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:42.302035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.313360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecc431-71fb-4716-ace7-1c6a98e27cd0 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.371703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.372436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.372737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.373034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] PATH_INFO: `/v3/projects/9083fa37d6ec40c6bf2b551c5d7f8177` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.374359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9083fa37d6ec40c6bf2b551c5d7f8177)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.376482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.402175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:42.426368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9083fa37d6ec40c6bf2b551c5d7f8177', 'request_id': 'req-16d09aea-bb8b-4f42-9d45-c95990df5d47'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.432729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9083fa37d6ec40c6bf2b551c5d7f8177', 'request_id': 'req-16d09aea-bb8b-4f42-9d45-c95990df5d47'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.441113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9083fa37d6ec40c6bf2b551c5d7f8177', 'request_id': 'req-16d09aea-bb8b-4f42-9d45-c95990df5d47'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.451658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] The token cache is being invalidate because project 9083fa37d6ec40c6bf2b551c5d7f8177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:15:42.451993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.452609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16d09aea-bb8b-4f42-9d45-c95990df5d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:42.454141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1170/2327] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:15:42 2022] DELETE /identity/v3/projects/9083fa37d6ec40c6bf2b551c5d7f8177 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:42.459106 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.459392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.459665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.480970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:42.482132 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:42.495823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:42.544185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1158/2328] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:42.556734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.557130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.557401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.581895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:42.583396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:42.600234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1171/2329] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:42.601071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.611933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f22243-8d86-414b-ac1f-e7e163c742c7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.624299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.625501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.626124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.626538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.627394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:15:42.627703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.629758 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.644419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1159/2330] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:15:42.649178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.663224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fc892-1dad-479a-bfa0-0a4fe841782a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.668602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.669255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.669537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.669799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.670429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.672393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.705106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1172/2331] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:15:42 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:15:42.709383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.720568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcbe89-3218-4d18-a624-7ec4fb99d59e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.790666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.791325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.791601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.792011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.792780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.794755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.818046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1160/2332] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:15:42 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:15:42.827111 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.837816 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cba8f9-b905-4041-9484-c52f3b45d0d4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.843420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.844334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.844670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.844945 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.845784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.847397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.861501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1173/2333] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:42.862756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.874019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd973-b171-4fd9-85dd-68173b5dad26 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.877763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf50f7c-eb73-480a-a52e-326995862b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.878350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f7c-eb73-480a-a52e-326995862b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.878620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f7c-eb73-480a-a52e-326995862b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.878886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f7c-eb73-480a-a52e-326995862b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.879550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf50f7c-eb73-480a-a52e-326995862b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.881192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf50f7c-eb73-480a-a52e-326995862b48 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.895350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1161/2334] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:42.897156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:42.908367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb3b9-83b1-4f5e-a0de-c05f9deb3a88 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:42.914006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:42.914668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.914943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.915208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] PATH_INFO: `/v3/projects/9686c96d6bec414ab93daea744d90c69/users/fa73ed70a9b94437b074f38b3916a861/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.930238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9686c96d6bec414ab93daea744d90c69, user_id=fa73ed70a9b94437b074f38b3916a861, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:42.932920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:42.947354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1174/2335] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:15:42 2022] PUT /identity/v3/projects/9686c96d6bec414ab93daea744d90c69/users/fa73ed70a9b94437b074f38b3916a861/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:42.957985 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:42.958321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:42.958588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:42.988311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] MFA Rules not processed for user `fa73ed70a9b94437b074f38b3916a861`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:42.989615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.068195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1162/2336] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:43.072247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.161690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801742a7-2dd4-4508-8036-54cee7e81f3b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.166288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.166895 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.167168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.167442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.168093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.170245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.204370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1175/2337] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:15:43 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:15:43.205927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.216584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43716e12-1cdb-48bc-b0b0-917ffd66af6a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.232108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:43.289696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.290317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.290590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.292010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.292808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.295881 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.329575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1163/2338] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:15:43 2022] POST /identity/v3/users => generated 309 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:15:43.334037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.349815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0c1cf-0de0-4af0-9500-a32ff6af7505 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.374123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec717df6-0a43-4d38-8bad-bd16c66d96f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.374878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717df6-0a43-4d38-8bad-bd16c66d96f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.375347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717df6-0a43-4d38-8bad-bd16c66d96f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.375681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717df6-0a43-4d38-8bad-bd16c66d96f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.380354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec717df6-0a43-4d38-8bad-bd16c66d96f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.384854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec717df6-0a43-4d38-8bad-bd16c66d96f4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.411043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1176/2339] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:43.413076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.429481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f064c-d228-4847-bc42-38b50def798f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.438171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.438865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.439143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.439422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] PATH_INFO: `/v3/projects/ba546e2d62324183b292d3adc233f9f3/users/03b0fe5bccda42ad9236eb2fa3cb3825/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.445715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.446004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.446258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.469019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:43.470258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.476594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba546e2d62324183b292d3adc233f9f3, user_id=03b0fe5bccda42ad9236eb2fa3cb3825, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.479728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.487681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:43.503768 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1164/2340] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:15:43 2022] PUT /identity/v3/projects/ba546e2d62324183b292d3adc233f9f3/users/03b0fe5bccda42ad9236eb2fa3cb3825/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:15:43.507720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.571676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1177/2341] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 10 11:15:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:15:43.595879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb179-7aac-4b9c-92f3-5d99d81d6f02 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.600703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.601536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.601839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.602054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.602846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.605162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.622189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1165/2342] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:43.623366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.625013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.625522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.635287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92547b5d-df0e-4a6e-80a2-88e1cdf91acf admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.640898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32004b89-6f43-4fbd-b037-1b5f30d23b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.641991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004b89-6f43-4fbd-b037-1b5f30d23b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.642269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004b89-6f43-4fbd-b037-1b5f30d23b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.642532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004b89-6f43-4fbd-b037-1b5f30d23b63 admin admin] PATH_INFO: `/v3/projects/ba546e2d62324183b292d3adc233f9f3/users/03b0fe5bccda42ad9236eb2fa3cb3825/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.644644 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32004b89-6f43-4fbd-b037-1b5f30d23b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba546e2d62324183b292d3adc233f9f3, user_id=03b0fe5bccda42ad9236eb2fa3cb3825, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.648179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32004b89-6f43-4fbd-b037-1b5f30d23b63 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.659260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1166/2343] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:15:43 2022] PUT /identity/v3/projects/ba546e2d62324183b292d3adc233f9f3/users/03b0fe5bccda42ad9236eb2fa3cb3825/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:43.671030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.671301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.671770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.710850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] MFA Rules not processed for user `03b0fe5bccda42ad9236eb2fa3cb3825`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:43.712435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.735166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680854f-cc57-427c-a28a-17b5a6e9f96a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.781940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:43.815145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1167/2344] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:43.822969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.824900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.837173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c760f82-451e-4b88-a535-9bd86516122a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.837798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760f82-451e-4b88-a535-9bd86516122a service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.838074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760f82-451e-4b88-a535-9bd86516122a service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.838343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760f82-451e-4b88-a535-9bd86516122a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.912456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21867-39ef-454e-9912-4b3a2ddbaa59 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.917781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.919135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.919408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.919673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.930276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c760f82-451e-4b88-a535-9bd86516122a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.931049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c760f82-451e-4b88-a535-9bd86516122a service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.932452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.934251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.957636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1168/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:43 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:15:43.959775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1178/2346] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:15:44.139863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:44.220122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0cfe8-1392-4543-81b7-9041fa31df1f service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:44.225273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:44.226045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:44.226422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:44.226864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] PATH_INFO: `/v3/users/fa73ed70a9b94437b074f38b3916a861` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:44.228025 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa73ed70a9b94437b074f38b3916a861)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:44.230187 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:44.281782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa73ed70a9b94437b074f38b3916a861'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:44.295627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa73ed70a9b94437b074f38b3916a861'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:44.302854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa73ed70a9b94437b074f38b3916a861'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:44.303789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa73ed70a9b94437b074f38b3916a861'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:44.305315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa73ed70a9b94437b074f38b3916a861'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:44.324110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1169/2347] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:15:44 2022] DELETE /identity/v3/users/fa73ed70a9b94437b074f38b3916a861 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:44.326797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:44.327183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:44.327999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:44.349092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:44.351205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:44.355597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:44.433018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1179/2348] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:44.444737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:44.446690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:44.462233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:44.512685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede475e-0810-41b6-9d8e-ca76f1dc6dcc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:44.516496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:44.517226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:44.517568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:44.517902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:44.527333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:44.528846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:44.540946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1170/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:45.025797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:45.028251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:45.046033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee7f1a-6b32-400b-aa36-f9454537272e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:45.050967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:45.051905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:45.052286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:45.052649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] PATH_INFO: `/v3/projects/9686c96d6bec414ab93daea744d90c69` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:45.054347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9686c96d6bec414ab93daea744d90c69)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:45.056414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:45.130295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9686c96d6bec414ab93daea744d90c69', 'request_id': 'req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.137492 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9686c96d6bec414ab93daea744d90c69', 'request_id': 'req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.149180 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9686c96d6bec414ab93daea744d90c69', 'request_id': 'req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.163200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] The token cache is being invalidate because project 9686c96d6bec414ab93daea744d90c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:15:45.163639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.164486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-abf5aa50-0abc-4b0f-9595-71a96a3fdb39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.169083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1180/2350] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:15:45 2022] DELETE /identity/v3/projects/9686c96d6bec414ab93daea744d90c69 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:45.170334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:45.183258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c75b32-d350-44aa-9a30-755651ee3395 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:45.312345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:45.313578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:45.313851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:45.314116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] PATH_INFO: `/v3/users/03b0fe5bccda42ad9236eb2fa3cb3825` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:45.316531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b0fe5bccda42ad9236eb2fa3cb3825)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:45.317877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:45.394746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b0fe5bccda42ad9236eb2fa3cb3825'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.419319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b0fe5bccda42ad9236eb2fa3cb3825'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.427350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b0fe5bccda42ad9236eb2fa3cb3825'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.428103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b0fe5bccda42ad9236eb2fa3cb3825'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.428761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b0fe5bccda42ad9236eb2fa3cb3825'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:45.458124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1171/2351] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:15:45 2022] DELETE /identity/v3/users/03b0fe5bccda42ad9236eb2fa3cb3825 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:45.485902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:45.487100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:45.487515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:45.512899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:45.514528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:45.610259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1181/2352] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:45.625285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:45.627220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:45.697663 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:45.763920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272111-907e-4058-8e0a-66ab32844fe5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:45.775885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb80b0-5172-4ae7-97f5-1352fabfb6dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:45.775885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb80b0-5172-4ae7-97f5-1352fabfb6dc service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:45.775885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb80b0-5172-4ae7-97f5-1352fabfb6dc service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:45.776200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb80b0-5172-4ae7-97f5-1352fabfb6dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:45.797005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb80b0-5172-4ae7-97f5-1352fabfb6dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:45.798648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb80b0-5172-4ae7-97f5-1352fabfb6dc service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:45.836233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1172/2353] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:15:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:15:45.886781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:45.888522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:45.976308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:46.018423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f375d41-5607-46c3-b732-fff6379ad584 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.027339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.028094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.028513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.029007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] PATH_INFO: `/v3/projects/ba546e2d62324183b292d3adc233f9f3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.030403 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba546e2d62324183b292d3adc233f9f3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.032570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.145026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba546e2d62324183b292d3adc233f9f3', 'request_id': 'req-7ccbcc8e-a73e-40d5-829c-9450a071be3e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:46.158582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba546e2d62324183b292d3adc233f9f3', 'request_id': 'req-7ccbcc8e-a73e-40d5-829c-9450a071be3e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:46.177480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba546e2d62324183b292d3adc233f9f3', 'request_id': 'req-7ccbcc8e-a73e-40d5-829c-9450a071be3e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:46.196943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] The token cache is being invalidate because project ba546e2d62324183b292d3adc233f9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:15:46.197786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:46.198809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7ccbcc8e-a73e-40d5-829c-9450a071be3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:46.206225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.207160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.207430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1182/2354] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:15:45 2022] DELETE /identity/v3/projects/ba546e2d62324183b292d3adc233f9f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:46.207799 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.241795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:46.243924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:46.363225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.363520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.363748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.375151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1173/2355] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:46.395799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:46.397087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:46.417037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.423918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1183/2356] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:46.430060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41cf4a-dff2-4472-932a-7d29de19f2b9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.447575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.448234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.448528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.448774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.449522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:15:46.449897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.451670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.481788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.487767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1174/2357] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:15:46.492259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dc5e6-58ac-46c3-87fb-b68e1125abe0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.502743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.503459 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.503732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.503993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.504684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.507084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.556531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.563234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1184/2358] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:15:46 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:15:46.567335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bbd8-46b7-40ba-b897-5114beacc1ce admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.680747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.681484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.681754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.682018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.682653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.684785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.725274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.726972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1175/2359] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:15:46 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:15:46.743162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849efa6-7845-48c0-a41e-d119718cd535 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.763101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.765762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.767119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.767434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.768123 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.769845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.801582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.803031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1185/2360] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:46.820680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d279fa-3076-4bb9-98ef-c06da2b46cae admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.832382 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36c29f-f613-4a7c-b652-d1cd08d81d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.835038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36c29f-f613-4a7c-b652-d1cd08d81d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.835423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36c29f-f613-4a7c-b652-d1cd08d81d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.837482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36c29f-f613-4a7c-b652-d1cd08d81d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.838191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36c29f-f613-4a7c-b652-d1cd08d81d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.839934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36c29f-f613-4a7c-b652-d1cd08d81d4b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.865963 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1176/2361] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:15:46.867549 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.880824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ad9f-de1c-484b-8d6f-7156c2c6685f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.893140 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.894167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.894632 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.895089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] PATH_INFO: `/v3/projects/b393d0a0942c467bae77c922a5ca1687/users/3b2091eba9744f66a6814926eedbfe77/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.931458 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b393d0a0942c467bae77c922a5ca1687, user_id=3b2091eba9744f66a6814926eedbfe77, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.934500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.957101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1186/2362] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:15:46 2022] PUT /identity/v3/projects/b393d0a0942c467bae77c922a5ca1687/users/3b2091eba9744f66a6814926eedbfe77/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:46.962277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.962801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.963214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.984337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:46.985858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:47.023098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:47.068088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1177/2363] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:15:47.079731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:47.084365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:47.177209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25074ab-45ab-488c-85b3-971776e97869 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:47.182481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02555d4-ceeb-46cd-9e42-912065e40c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:47.183284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02555d4-ceeb-46cd-9e42-912065e40c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:47.183857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02555d4-ceeb-46cd-9e42-912065e40c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:47.184276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02555d4-ceeb-46cd-9e42-912065e40c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:47.218391 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02555d4-ceeb-46cd-9e42-912065e40c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:47.223756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02555d4-ceeb-46cd-9e42-912065e40c78 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:47.251848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1187/2364] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:15:47.666489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:47.668874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:47.796388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475e9a6-06de-4696-b9df-f5d5a02d4e29 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:47.810851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:47.812274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:47.812790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:47.813393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:47.816893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:47.901797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:47.904154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:47.917788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1178/2365] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:48.216837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.217947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.218431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.240908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:48.278300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] MFA Rules not processed for user `3b2091eba9744f66a6814926eedbfe77`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:48.279564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:48.407857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1188/2366] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:48.412163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:48.426975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe212b-e9a5-4dec-ac62-f409848ac316 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:48.434908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:48.435943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.436499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.437986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.439038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:48.441245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:48.501792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1179/2367] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:15:48 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:15:48.505277 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:48.521509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedb00f-15b3-41a1-9bce-e7db6d6dab72 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:48.602990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:48.603805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.604249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.604679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.605495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:48.607999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:48.653039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1189/2368] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:15:48 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:15:48.657423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:48.692126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd456c-f4fc-4f19-83f7-9ca74f2bd72e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:48.700259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:48.701759 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.702255 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.702728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.704409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:48.708051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:48.740972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1180/2369] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:48.745076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:48.795233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff917a75-100d-4ac3-bf98-380f736c528f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:48.811206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:48.816668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.817132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.828269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] PATH_INFO: `/v3/projects/7a3f9c4c8aa947948ef79d2710880fa2/users/10d50904e97f4e0aa29bbe12ab791ffe/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.864142 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3f9c4c8aa947948ef79d2710880fa2, user_id=10d50904e97f4e0aa29bbe12ab791ffe, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:48.867454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:48.904229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1190/2370] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:15:48 2022] PUT /identity/v3/projects/7a3f9c4c8aa947948ef79d2710880fa2/users/10d50904e97f4e0aa29bbe12ab791ffe/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:48.905457 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:48.922827 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d15e-cb71-4a78-b131-bc8aa2c3aad8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:48.970349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:49.007557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e200030-c463-4814-95ec-11e08394e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:49.008137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e200030-c463-4814-95ec-11e08394e48a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:49.008137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e200030-c463-4814-95ec-11e08394e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:49.008469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e200030-c463-4814-95ec-11e08394e48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:49.009145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e200030-c463-4814-95ec-11e08394e48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:49.010832 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e200030-c463-4814-95ec-11e08394e48a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:49.024760 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1181/2371] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:15:49.029370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:49.043162 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e57e-0f52-487b-9521-8e144f278a6c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:49.048672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b37275-61f1-4818-a67a-52bff722ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:49.049424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b37275-61f1-4818-a67a-52bff722ddf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:49.049706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b37275-61f1-4818-a67a-52bff722ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:49.049960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b37275-61f1-4818-a67a-52bff722ddf1 admin admin] PATH_INFO: `/v3/projects/7a3f9c4c8aa947948ef79d2710880fa2/users/10d50904e97f4e0aa29bbe12ab791ffe/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:49.052341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b37275-61f1-4818-a67a-52bff722ddf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3f9c4c8aa947948ef79d2710880fa2, user_id=10d50904e97f4e0aa29bbe12ab791ffe, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:49.083194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b37275-61f1-4818-a67a-52bff722ddf1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:49.128999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1191/2372] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:15:49 2022] PUT /identity/v3/projects/7a3f9c4c8aa947948ef79d2710880fa2/users/10d50904e97f4e0aa29bbe12ab791ffe/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:15:50.568451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:50.569062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:50.569062 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:50.654265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] MFA Rules not processed for user `10d50904e97f4e0aa29bbe12ab791ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:50.656407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:50.905923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1182/2373] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:50.916743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:50.917342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:50.917342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:50.966135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] MFA Rules not processed for user `3b2091eba9744f66a6814926eedbfe77`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:50.967472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.064527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:51.087347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1192/2374] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:51.099908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:51.101252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.222615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5742e-8a63-4fc8-8bb0-1a53d9e6e069 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:51.234392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:51.235028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.235303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.235571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.251957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:51.254424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:51.289003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1183/2375] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:51.822493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:51.824220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.909214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350375-d226-4673-adfc-b97ce1fd6b21 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:51.933455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:51.934088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.934366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.934634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.937055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.952791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:51.954926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:51.970654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1193/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:52.528730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:52.530311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:52.614286 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:52.658360 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a023b-6e56-4e69-b4a7-f041c0b2e557 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:52.667772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:52.669192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:52.669658 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:52.670137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:52.672263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:52.687192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:52.689578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b096-a02a-48f5-ba43-795b023e1a5d service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:52.702620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1184/2377] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:55.770685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:55.772830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:55.884555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbcfb7-d68c-49ea-9600-bd02adda5269 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:55.889768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:55.890478 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:55.890927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:55.891204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] PATH_INFO: `/v3/users/9f23fbce0dfc493a819ff266b5c2ff22` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:55.894036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f23fbce0dfc493a819ff266b5c2ff22)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:55.896316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:55.996183 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f23fbce0dfc493a819ff266b5c2ff22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.019419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f23fbce0dfc493a819ff266b5c2ff22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.042879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f23fbce0dfc493a819ff266b5c2ff22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.043936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f23fbce0dfc493a819ff266b5c2ff22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.044552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c5b3a0de-915b-4e8c-b302-022c83cb7a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f23fbce0dfc493a819ff266b5c2ff22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.087938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1194/2378] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:15:55 2022] DELETE /identity/v3/users/9f23fbce0dfc493a819ff266b5c2ff22 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:56.093334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807da9-6446-409b-8572-e43a562a10f7 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.093952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807da9-6446-409b-8572-e43a562a10f7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.094092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807da9-6446-409b-8572-e43a562a10f7 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.096019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1185/2379] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:56.148279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.148279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.148279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.186428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] MFA Rules not processed for user `fef62b1004224069a326d0ce684e9307`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:56.187795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.201388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:56.262865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1195/2380] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:15:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:56.280364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807da9-6446-409b-8572-e43a562a10f7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:56.282749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9c807da9-6446-409b-8572-e43a562a10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.299400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807da9-6446-409b-8572-e43a562a10f7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:56.303460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655a16-dcc5-433f-bb3c-6e5af1a38c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:56.304283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655a16-dcc5-433f-bb3c-6e5af1a38c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.304705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655a16-dcc5-433f-bb3c-6e5af1a38c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.305273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655a16-dcc5-433f-bb3c-6e5af1a38c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.317159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655a16-dcc5-433f-bb3c-6e5af1a38c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:56.319471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655a16-dcc5-433f-bb3c-6e5af1a38c15 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:56.331739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1186/2381] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:56.479977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:56.481477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.504740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176785-3657-4719-9ef5-b380d83a02a0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.505055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176785-3657-4719-9ef5-b380d83a02a0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.505449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176785-3657-4719-9ef5-b380d83a02a0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.507175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1187/2382] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 10 11:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:56.513407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.513690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.513937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.566227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] MFA Rules not processed for user `ded8e23edf404c378eba94e917be0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:56.570123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.603704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987a67f-d3ad-46f7-8c30-ea58ec86c012 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:56.610307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:56.611091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.612520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.612520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] PATH_INFO: `/v3/projects/04a34bfad4984b52bacd6b3a0941091a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.613585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a34bfad4984b52bacd6b3a0941091a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:56.617917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:56.681181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1188/2383] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 10 11:15:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:15:56.693100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:56.694904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.698581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a34bfad4984b52bacd6b3a0941091a', 'request_id': 'req-e6350196-e07a-4a4d-9855-d1803a534853'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.708359 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a34bfad4984b52bacd6b3a0941091a', 'request_id': 'req-e6350196-e07a-4a4d-9855-d1803a534853'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.714051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39564f8a-1cff-47cf-91ad-2e94ee0fc5ad None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:56.724017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a34bfad4984b52bacd6b3a0941091a', 'request_id': 'req-e6350196-e07a-4a4d-9855-d1803a534853'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.757038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] The token cache is being invalidate because project 04a34bfad4984b52bacd6b3a0941091a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:15:56.757342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.759186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:56.775786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1196/2384] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:15:56 2022] DELETE /identity/v3/projects/04a34bfad4984b52bacd6b3a0941091a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:56.783865 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:56.788941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:56.789916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.790346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.790767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.794600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.795532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:56.932750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:56.959730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:56.962853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:56.964441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:56.966934 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350196-e07a-4a4d-9855-d1803a534853 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:56.988592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:56.989998 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:56.990342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:56.991295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] PATH_INFO: `/v3/users/c9ff053497c64d5eaa78de7dee687f7f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:56.992143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1189/2385] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:15:56.992821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ff053497c64d5eaa78de7dee687f7f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:56.995703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:57.083613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ff053497c64d5eaa78de7dee687f7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.111641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ff053497c64d5eaa78de7dee687f7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.130017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ff053497c64d5eaa78de7dee687f7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.130783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ff053497c64d5eaa78de7dee687f7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.131555 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ff053497c64d5eaa78de7dee687f7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.150260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1197/2386] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:15:56 2022] DELETE /identity/v3/users/c9ff053497c64d5eaa78de7dee687f7f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:15:57.449910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:57.466727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bebd3-22bd-49f7-93c8-f3b6942b6e28 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:57.595974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:57.597409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:57.597721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:57.597946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] PATH_INFO: `/v3/projects/814dc85ef69e4921bc7c9361eba0e1a8` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:57.599513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814dc85ef69e4921bc7c9361eba0e1a8)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:57.602393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:57.670736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814dc85ef69e4921bc7c9361eba0e1a8', 'request_id': 'req-42992655-5692-4322-8809-ef047a4d2ea2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.690304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814dc85ef69e4921bc7c9361eba0e1a8', 'request_id': 'req-42992655-5692-4322-8809-ef047a4d2ea2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.701437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814dc85ef69e4921bc7c9361eba0e1a8', 'request_id': 'req-42992655-5692-4322-8809-ef047a4d2ea2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.717897 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] The token cache is being invalidate because project 814dc85ef69e4921bc7c9361eba0e1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:15:57.718204 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.718863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:15:57.720674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1190/2387] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:15:57 2022] DELETE /identity/v3/projects/814dc85ef69e4921bc7c9361eba0e1a8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:05.972290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:05.973832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:06.042318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c66f6-3a02-41f1-a95b-e1ca7d72eed3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:06.104770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:06.105653 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:06.106024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:06.106325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:06.108266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:06.118890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:06.120473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:06.134198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1198/2388] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:06.493449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:06.495005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:06.563151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42992655-5692-4322-8809-ef047a4d2ea2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:06.566794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:06.567409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:06.567737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:06.568009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:06.569847 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:06.607239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:06.646797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:06.648271 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f03fb-64db-4a1d-91c0-6fe1d2261563 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:06.663041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1191/2389] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:09.743749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:09.745799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:09.781944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:09.828244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe093-9453-441a-bc98-8a3623726d8f service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:09.833815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:09.834424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:09.834696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:09.834972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:09.836718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:09.898132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:09.899961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:09.911084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1199/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:10.392023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:10.392509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:10.392605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:10.412173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:10.413394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:10.467210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1192/2391] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:16:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:10.479490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:10.480972 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:10.554507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c320c-5075-4bf4-8d13-69ab024f912a service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:10.559515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:10.560150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:10.560422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:10.560690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:10.568860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:10.570446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:10.578279 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1200/2392] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:16:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:16:20.460301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=39 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:20.575204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=73 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:23.729015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:23.731719 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:23.751083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a676b-f31f-458d-add4-3100c2cf9aaf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:23.758857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:23.759495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:23.759773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:23.760044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:23.762497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:23.781611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:23.783380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:23.796310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1193/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:26.114795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:26.131465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc82e-f4fe-43a1-b825-6de685f8da4c service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:26.136852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:26.137656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.138015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.138215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.140091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:26.164350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:26.168243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a8b1f-72f7-4aa1-b393-98353af6e66f service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:26.180824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1201/2394] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:26.318755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:26.323270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:26.410228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4fc1c-2118-4f83-b700-2f5f7dcd7af9 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:26.415787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:26.416563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.416902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.417170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] PATH_INFO: `/v3/users/3b2091eba9744f66a6814926eedbfe77` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.418533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2091eba9744f66a6814926eedbfe77)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:26.420468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:26.511368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2091eba9744f66a6814926eedbfe77'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.525373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2091eba9744f66a6814926eedbfe77'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.534249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2091eba9744f66a6814926eedbfe77'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.535030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2091eba9744f66a6814926eedbfe77'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.535664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2091eba9744f66a6814926eedbfe77'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.557720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1194/2395] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:26 2022] DELETE /identity/v3/users/3b2091eba9744f66a6814926eedbfe77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:26.608171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.608440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.608731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.670586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:26.672447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:26.757473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1202/2396] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 10 11:16:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:26.773942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:26.775563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:26.784332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:26.788351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:26.874718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaba18-0fb5-4fde-a0d4-c493410564cc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:26.881403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:26.882411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.882924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.883131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3fab0-19c6-4eee-b8aa-14dacb0ff287 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:26.883496 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.887958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:26.888596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.888867 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.889167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] PATH_INFO: `/v3/projects/b393d0a0942c467bae77c922a5ca1687` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.890429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b393d0a0942c467bae77c922a5ca1687)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:26.892457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:26.893840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:26.897630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:26.899558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:26.921030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1195/2397] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:16:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:16:26.970096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b393d0a0942c467bae77c922a5ca1687', 'request_id': 'req-ecad3abb-18da-44b3-98bf-3abb36342d16'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.977222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b393d0a0942c467bae77c922a5ca1687', 'request_id': 'req-ecad3abb-18da-44b3-98bf-3abb36342d16'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:26.990860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b393d0a0942c467bae77c922a5ca1687', 'request_id': 'req-ecad3abb-18da-44b3-98bf-3abb36342d16'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.003821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] The token cache is being invalidate because project b393d0a0942c467bae77c922a5ca1687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:27.004163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.004790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.010782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1203/2398] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:26 2022] DELETE /identity/v3/projects/b393d0a0942c467bae77c922a5ca1687 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:27.014499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:27.026124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde83df6-70c2-45c0-ba97-fe76e9c384c4 service swift] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:27.099033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:27.099894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:27.100173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:27.100474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] PATH_INFO: `/v3/users/10d50904e97f4e0aa29bbe12ab791ffe` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:27.101739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d50904e97f4e0aa29bbe12ab791ffe)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:27.103838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:27.176745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d50904e97f4e0aa29bbe12ab791ffe'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.195747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d50904e97f4e0aa29bbe12ab791ffe'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.204281 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d50904e97f4e0aa29bbe12ab791ffe'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.205276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d50904e97f4e0aa29bbe12ab791ffe'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.205859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-989e5567-8dd5-40b3-bac9-6537fa0e6f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d50904e97f4e0aa29bbe12ab791ffe'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.222728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1196/2399] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:27 2022] DELETE /identity/v3/users/10d50904e97f4e0aa29bbe12ab791ffe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:27.778853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:27.780388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:27.793929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3abb-18da-44b3-98bf-3abb36342d16 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:27.815145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:27.855301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:27.855959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:27.856234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:27.856498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] PATH_INFO: `/v3/projects/7a3f9c4c8aa947948ef79d2710880fa2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:27.857743 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3f9c4c8aa947948ef79d2710880fa2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:27.859683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:27.908435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3f9c4c8aa947948ef79d2710880fa2', 'request_id': 'req-b0730bc8-0761-402b-9fa8-582e29072226'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.914405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3f9c4c8aa947948ef79d2710880fa2', 'request_id': 'req-b0730bc8-0761-402b-9fa8-582e29072226'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.923395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3f9c4c8aa947948ef79d2710880fa2', 'request_id': 'req-b0730bc8-0761-402b-9fa8-582e29072226'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.933588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] The token cache is being invalidate because project 7a3f9c4c8aa947948ef79d2710880fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:27.933868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.934471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b0730bc8-0761-402b-9fa8-582e29072226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:27.935928 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1204/2400] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:27 2022] DELETE /identity/v3/projects/7a3f9c4c8aa947948ef79d2710880fa2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:27.941037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:27.941535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:27.941629 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:27.961833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:27.963105 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.027596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1197/2401] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:28.036216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.036511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.036913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.059749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:28.061100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.072009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1205/2402] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:28.073549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.083596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126634-19aa-48c4-b3be-3c95ea5e4095 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.089079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.089684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.089952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.090213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.090850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:28.091143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.092729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.105727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1198/2403] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:28.110105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.120333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c7f53-3e15-4a5c-8120-0837211d1abe None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.125247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.126161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.126501 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.126942 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.127815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.130033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.162742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1206/2404] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:28.164084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.169610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:28.175412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ceb0-1fb0-499d-a745-fcd6fdf4a582 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.250509 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.251573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.251848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.252112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.252737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.254815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.277063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1199/2405] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:28.281139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.292006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e017de2-17e8-47b0-b1da-bc16020d8f6c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.296586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.297201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.297482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.297749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.298388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.299981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.310668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1207/2406] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:28.314541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.325181 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9af8b2-e1d6-4e1d-ad0f-9b823970d060 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.330070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6eb82-bd71-41eb-af2a-4a7e81fb93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.330750 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6eb82-bd71-41eb-af2a-4a7e81fb93d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.331023 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6eb82-bd71-41eb-af2a-4a7e81fb93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.331322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6eb82-bd71-41eb-af2a-4a7e81fb93d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.332015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6eb82-bd71-41eb-af2a-4a7e81fb93d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.333677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6eb82-bd71-41eb-af2a-4a7e81fb93d2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.344695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1200/2407] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:28.349026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.359377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13301d5d-d3a3-4940-b79f-54c6ca61edf6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.365107 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.365852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.366256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.366461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] PATH_INFO: `/v3/projects/d284397ba0f746a0862428a4214e752e/users/432036ffd7e24d459baa90dede60fb02/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.381961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284397ba0f746a0862428a4214e752e, user_id=432036ffd7e24d459baa90dede60fb02, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.384708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.398513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1208/2408] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:28 2022] PUT /identity/v3/projects/d284397ba0f746a0862428a4214e752e/users/432036ffd7e24d459baa90dede60fb02/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:28.408845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.409149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.409419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.436284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] MFA Rules not processed for user `432036ffd7e24d459baa90dede60fb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:28.437537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.504584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1201/2409] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:28.509224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.556963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:28.576252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d89a6b-247a-4429-9196-f85189d11300 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.581572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.582208 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.582507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.582768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.583390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.585335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.614966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1209/2410] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:28.618891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.630473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eee9b3-5fe1-416b-a962-9bfdf7853c41 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.698817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.700590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.700590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.700590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.700888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.703352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.722466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:28.734090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1202/2411] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:28.736012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.749540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9436-e0e4-46f6-9bb5-9bd6e5f65e6f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.757105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.757683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.757955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.758216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.758858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.760460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.771868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1210/2412] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:28.776451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.787570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672f67-e96e-4b5d-bd5c-852c6a327bdc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.792583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.793280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.793557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.793851 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] PATH_INFO: `/v3/projects/45477bcab7ea4349a2fdf93159c9775e/users/f576ba4fea6e46b0b61b5699f4bcd458/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.809149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45477bcab7ea4349a2fdf93159c9775e, user_id=f576ba4fea6e46b0b61b5699f4bcd458, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.812042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.825597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1203/2413] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:28 2022] PUT /identity/v3/projects/45477bcab7ea4349a2fdf93159c9775e/users/f576ba4fea6e46b0b61b5699f4bcd458/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:28.830092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.841210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eae59b-30e5-4a5a-a7c6-af1a5b2af426 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.899004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.900674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.902409 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.902907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.903182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.903497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.904143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.905864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.916807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1211/2414] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:28.921259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.931317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f159994-bb05-4d32-8149-a9788117df61 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.936769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ac8c4-5a04-4184-9df9-d3a4668a8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.937717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac8c4-5a04-4184-9df9-d3a4668a8689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.938154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac8c4-5a04-4184-9df9-d3a4668a8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.938425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac8c4-5a04-4184-9df9-d3a4668a8689 admin admin] PATH_INFO: `/v3/projects/45477bcab7ea4349a2fdf93159c9775e/users/f576ba4fea6e46b0b61b5699f4bcd458/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.940517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ac8c4-5a04-4184-9df9-d3a4668a8689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45477bcab7ea4349a2fdf93159c9775e, user_id=f576ba4fea6e46b0b61b5699f4bcd458, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.943288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ac8c4-5a04-4184-9df9-d3a4668a8689 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.954139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1212/2415] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:28 2022] PUT /identity/v3/projects/45477bcab7ea4349a2fdf93159c9775e/users/f576ba4fea6e46b0b61b5699f4bcd458/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:28.965422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.965817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.966122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.980236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e044-b0b6-4d24-bdbc-7395297584d8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.993795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] MFA Rules not processed for user `f576ba4fea6e46b0b61b5699f4bcd458`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:28.994986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:29.044165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:29.044993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:29.045378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:29.045742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:29.047690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:29.074273 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1213/2416] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:29.085276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:29.086641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:29.107247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:29.108947 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:29.119282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1204/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:29.122405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:29.147673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3613-839a-4d15-b6dd-413200fa3825 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:29.151302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:29.151870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:29.152143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:29.152407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:29.211299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:29.212739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:29.222207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1214/2418] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:32.361812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:32.363490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:32.377247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:32.422727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5143898-a113-4cdf-9f9c-7ee668a75941 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:32.426405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:32.427073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:32.427346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:32.427617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:32.429516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:32.492959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:32.494418 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:32.503899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1205/2419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:33.520970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:33.528731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7d5b6-6a43-4034-bcb1-2dbe6552111e service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:33.532597 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:33.533311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:33.533593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:33.533847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:33.545885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:33.547423 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:33.557319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1215/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:35.760523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:35.762879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:35.777450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4fc1b-c33c-4494-ac35-0dbf5144739c service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:35.782034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:35.782696 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:35.782941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:35.783226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] PATH_INFO: `/v3/users/8256ead2715c4dd0809f856db9e9811b` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:35.785270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8256ead2715c4dd0809f856db9e9811b)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:35.787307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:35.839723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8256ead2715c4dd0809f856db9e9811b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:35.851932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8256ead2715c4dd0809f856db9e9811b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:35.858688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8256ead2715c4dd0809f856db9e9811b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:35.859356 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8256ead2715c4dd0809f856db9e9811b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:35.860237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2b95b81d-f0d2-45ca-b445-47b0f93de470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8256ead2715c4dd0809f856db9e9811b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:35.874284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1206/2421] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:35 2022] DELETE /identity/v3/users/8256ead2715c4dd0809f856db9e9811b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:36.063932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.076596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425697-dcf8-4f97-88e4-3bcd3ce0fbef service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.140514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.141264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.141542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.141812 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] PATH_INFO: `/v3/projects/f23d09c67d8d47fba9b6d09925dea02e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.143174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23d09c67d8d47fba9b6d09925dea02e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.145658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.196493 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23d09c67d8d47fba9b6d09925dea02e', 'request_id': 'req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:36.203289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23d09c67d8d47fba9b6d09925dea02e', 'request_id': 'req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:36.212137 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23d09c67d8d47fba9b6d09925dea02e', 'request_id': 'req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:36.223456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] The token cache is being invalidate because project f23d09c67d8d47fba9b6d09925dea02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:36.223781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:36.224471 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-55c53b24-e198-4152-b5c0-4a6fa1e7ea2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:36.226104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1216/2422] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:36 2022] DELETE /identity/v3/projects/f23d09c67d8d47fba9b6d09925dea02e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:36.231820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.232127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.232445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.254747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:36.256582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:36.290425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:36.325891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1207/2423] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:36.334324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.334634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.334906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.342690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:36.360725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:36.362849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:36.373871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1217/2424] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:36.378488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.389385 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dada4e-decc-4096-be6c-9e07ee78d0a3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.394003 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.394605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.394884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.395142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.395852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:36.396135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.397780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.413196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1208/2425] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:36.414316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.423684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6e81-d799-4cfc-9ec0-97c5cfb620ad None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.428283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.428874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.429187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.429455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.430080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.431977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.459738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1218/2426] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:36 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:36.464196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.474743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07181b-e4db-435d-80f6-a2a1e15c4976 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.536370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.537235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.537515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.537785 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.538450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.540432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.565834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1209/2427] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:36 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:36.567461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.578841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89aaf9-3787-4538-ba39-fe1006bce940 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.584387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.585013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.585283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.585544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.586184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.587791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.598494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1219/2428] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:36.602811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.613395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba01cac-dd8c-4716-a7b5-83b161968b33 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.619825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46732-cbdc-4300-8d28-c9784cb22a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.620428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46732-cbdc-4300-8d28-c9784cb22a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.620731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46732-cbdc-4300-8d28-c9784cb22a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.621029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46732-cbdc-4300-8d28-c9784cb22a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.621723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f46732-cbdc-4300-8d28-c9784cb22a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.623388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f46732-cbdc-4300-8d28-c9784cb22a01 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.634786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1210/2429] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:36.638954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.649486 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5dd50-a108-4a6b-b0bb-eca3ed73f51b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.655300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.655950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.656231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.656500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] PATH_INFO: `/v3/projects/321303840295494398a325b8695613dc/users/ed7cad6c40fb4b98a42b897f7795fb53/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.672151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321303840295494398a325b8695613dc, user_id=ed7cad6c40fb4b98a42b897f7795fb53, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.674861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.688944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1220/2430] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:36 2022] PUT /identity/v3/projects/321303840295494398a325b8695613dc/users/ed7cad6c40fb4b98a42b897f7795fb53/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:36.699638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.699919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.700183 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.729174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] MFA Rules not processed for user `ed7cad6c40fb4b98a42b897f7795fb53`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:36.730416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:36.798724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1211/2431] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:36.809951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.812000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:36.889055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95212-9a2a-40e6-a692-90f3ecfd2c02 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.894975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88356-bfc1-4741-976a-863b4aaa1e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:36.895664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88356-bfc1-4741-976a-863b4aaa1e94 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.895864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88356-bfc1-4741-976a-863b4aaa1e94 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.896134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88356-bfc1-4741-976a-863b4aaa1e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.904656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88356-bfc1-4741-976a-863b4aaa1e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:36.906283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88356-bfc1-4741-976a-863b4aaa1e94 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:36.915398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1221/2432] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:38.598733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:38.599595 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:38.632937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:38.677074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a59c99-90b3-4b49-a4a1-84c47c040293 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:38.682080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:38.683121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:38.683370 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:38.683656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] PATH_INFO: `/v3/users/432036ffd7e24d459baa90dede60fb02` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:38.685053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432036ffd7e24d459baa90dede60fb02)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:38.687048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:38.743327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432036ffd7e24d459baa90dede60fb02'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:38.759136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432036ffd7e24d459baa90dede60fb02'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:38.767646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432036ffd7e24d459baa90dede60fb02'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:38.768384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432036ffd7e24d459baa90dede60fb02'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:38.769087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432036ffd7e24d459baa90dede60fb02'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:38.783542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1212/2433] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:38 2022] DELETE /identity/v3/users/432036ffd7e24d459baa90dede60fb02 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:38.787864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:38.788296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:38.788602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:38.807262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:38.808740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:38.876744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1222/2434] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:38.886857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:38.888377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:38.948752 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ce8d-1c45-46a6-8a1d-d78517cfc357 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:38.952371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:38.953071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:38.953388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:38.953631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:38.963704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:38.965198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:38.975044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1213/2435] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:39.263073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:39.264747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.279170 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ab11e-338a-4e69-83de-92a2b36f862a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:39.285007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:39.285991 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.286269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.286531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] PATH_INFO: `/v3/projects/d284397ba0f746a0862428a4214e752e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.288627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d284397ba0f746a0862428a4214e752e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:39.290572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:39.314220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:39.340460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd284397ba0f746a0862428a4214e752e', 'request_id': 'req-0c49561f-a5ed-42cc-9a6b-94978603f50b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.346883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd284397ba0f746a0862428a4214e752e', 'request_id': 'req-0c49561f-a5ed-42cc-9a6b-94978603f50b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.354951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd284397ba0f746a0862428a4214e752e', 'request_id': 'req-0c49561f-a5ed-42cc-9a6b-94978603f50b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.366793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] The token cache is being invalidate because project d284397ba0f746a0862428a4214e752e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:39.367075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.367718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.369263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1223/2436] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:39 2022] DELETE /identity/v3/projects/d284397ba0f746a0862428a4214e752e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:39.373665 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:39.384082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efde35c-6212-48ab-aa6e-cb73cc9892dc service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:39.444703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:39.457775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:39.458563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.458867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.459135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] PATH_INFO: `/v3/users/f576ba4fea6e46b0b61b5699f4bcd458` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.460626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f576ba4fea6e46b0b61b5699f4bcd458)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:39.462637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:39.510243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f576ba4fea6e46b0b61b5699f4bcd458'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.521763 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f576ba4fea6e46b0b61b5699f4bcd458'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.528591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f576ba4fea6e46b0b61b5699f4bcd458'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.529287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f576ba4fea6e46b0b61b5699f4bcd458'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.529870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3b751651-ab1e-4e45-bbf8-450c343faceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f576ba4fea6e46b0b61b5699f4bcd458'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.544672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1214/2437] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:39 2022] DELETE /identity/v3/users/f576ba4fea6e46b0b61b5699f4bcd458 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:39.633714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:39.635253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.648466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49561f-a5ed-42cc-9a6b-94978603f50b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:39.709983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:39.710240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.710453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.710719 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] PATH_INFO: `/v3/users/ed7cad6c40fb4b98a42b897f7795fb53` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.711881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7cad6c40fb4b98a42b897f7795fb53)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:39.713979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:39.764684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7cad6c40fb4b98a42b897f7795fb53'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.774788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7cad6c40fb4b98a42b897f7795fb53'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.790691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7cad6c40fb4b98a42b897f7795fb53'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.791885 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7cad6c40fb4b98a42b897f7795fb53'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.792224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7cad6c40fb4b98a42b897f7795fb53'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:39.807730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1224/2438] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:39 2022] DELETE /identity/v3/users/ed7cad6c40fb4b98a42b897f7795fb53 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:39.812725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.813391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.813391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.835365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:39.836642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.838258 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:39.840236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.889489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:39.922219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1215/2439] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:39.932131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:39.934413 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f0dc3-8959-43bf-95d5-d87fd41f3adf admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:39.938066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.939456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:39.940302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.940742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.941229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] PATH_INFO: `/v3/projects/45477bcab7ea4349a2fdf93159c9775e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.942334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45477bcab7ea4349a2fdf93159c9775e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:39.949363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:39.998562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be99ae-cb08-45d2-bf86-e04b950b37eb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:39.998845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45477bcab7ea4349a2fdf93159c9775e', 'request_id': 'req-4819320a-1710-466a-b658-abaa2298185f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.006840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45477bcab7ea4349a2fdf93159c9775e', 'request_id': 'req-4819320a-1710-466a-b658-abaa2298185f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.026717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:40.028944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45477bcab7ea4349a2fdf93159c9775e', 'request_id': 'req-4819320a-1710-466a-b658-abaa2298185f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.044542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] The token cache is being invalidate because project 45477bcab7ea4349a2fdf93159c9775e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:40.045173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.045902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4819320a-1710-466a-b658-abaa2298185f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.047764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1225/2440] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:39 2022] DELETE /identity/v3/projects/45477bcab7ea4349a2fdf93159c9775e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:40.056150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344fd0-1ea2-4328-b59c-020ce89a41fb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.056466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344fd0-1ea2-4328-b59c-020ce89a41fb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.056698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344fd0-1ea2-4328-b59c-020ce89a41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.058852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.060599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.061016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.061308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.063864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.076907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b6344fd0-1ea2-4328-b59c-020ce89a41fb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:40.078261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b6344fd0-1ea2-4328-b59c-020ce89a41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.148905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.150472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.153084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1226/2441] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:40.161571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.161989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.162312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.167210 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1216/2442] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:40.182115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:40.183310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.196370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1227/2443] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:40.198333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.209458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440d65d-a12f-49b8-a62d-01e4f18338f3 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.214313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.214923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.215194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.215458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.216153 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:40.216574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.218265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.233483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1217/2444] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:40.237852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.248685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7241e-d5b6-4dd9-b566-dd3bd540ed0c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.254242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.254969 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.255363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.255782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.257329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.259453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.290919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1228/2445] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:40.295135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.305603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8da5-40b1-48b0-9779-ff57ae04685c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.380380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.381412 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.381786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.382530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.382886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.385149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.413017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1218/2446] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:40.416609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.427595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff99b2-0df3-47e9-a8c1-761ed5793e4c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.433805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.434605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.435038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.435451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.436252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.438068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.450644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1229/2447] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:40.455284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.472894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c625419-25bc-421a-bfe4-155980b76ae8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.478180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.479000 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.479115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.479377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.480017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.482504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.498584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.500339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.501071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1219/2448] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:40.502248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.514640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41576-844f-4a49-80e1-11aec2ace08c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.517742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3a9a-a78d-4542-bb3e-6b22c0d8f4e7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.522531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.523206 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.523456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfb918-7aac-46a8-ab9b-f2883c66d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.523598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.523937 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] PATH_INFO: `/v3/projects/321303840295494398a325b8695613dc` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.524442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb918-7aac-46a8-ab9b-f2883c66d141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.524848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb918-7aac-46a8-ab9b-f2883c66d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.525203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb918-7aac-46a8-ab9b-f2883c66d141 admin admin] PATH_INFO: `/v3/projects/0a575b01088548dea937750d44bef8a4/users/29c013c2f0e949929758380f8ff6d29e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.526078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=321303840295494398a325b8695613dc)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.535290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.548862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb918-7aac-46a8-ab9b-f2883c66d141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a575b01088548dea937750d44bef8a4, user_id=29c013c2f0e949929758380f8ff6d29e, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.552746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb918-7aac-46a8-ab9b-f2883c66d141 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.553253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:40.570387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1220/2449] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:40 2022] PUT /identity/v3/projects/0a575b01088548dea937750d44bef8a4/users/29c013c2f0e949929758380f8ff6d29e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:40.582060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.582633 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.583175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.604618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321303840295494398a325b8695613dc', 'request_id': 'req-5080336d-5824-47da-ae06-cc763fdfb07a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.611039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321303840295494398a325b8695613dc', 'request_id': 'req-5080336d-5824-47da-ae06-cc763fdfb07a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.619040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] MFA Rules not processed for user `29c013c2f0e949929758380f8ff6d29e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:40.620802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.623964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321303840295494398a325b8695613dc', 'request_id': 'req-5080336d-5824-47da-ae06-cc763fdfb07a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.627498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:40.638475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] The token cache is being invalidate because project 321303840295494398a325b8695613dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:40.639075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.640042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5080336d-5824-47da-ae06-cc763fdfb07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:40.641489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1230/2450] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:40 2022] DELETE /identity/v3/projects/321303840295494398a325b8695613dc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:40.646349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e674d-9e45-4bc4-b522-d9afe8c66b33 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.646643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e674d-9e45-4bc4-b522-d9afe8c66b33 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.647316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e674d-9e45-4bc4-b522-d9afe8c66b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.667491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c63e674d-9e45-4bc4-b522-d9afe8c66b33 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:40.668827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c63e674d-9e45-4bc4-b522-d9afe8c66b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.701873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1221/2451] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:40.713069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.714776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.728997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1231/2452] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:40.736810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.737131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.737431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.759033 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:40.760240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.768193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1232/2453] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:40.772348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.777510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c318f-9d3a-4dcd-8c20-cffcd269389b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.781113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.781347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d7af-0e19-41fd-8e6b-c902d0a27f62 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.781842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.781980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.782242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.789185 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.789829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.790099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.790389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.791027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:40.791561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.791641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.792874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.793003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.802016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1222/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:40.806913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1233/2455] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:16:40.811115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.821655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ef06e-bdca-4347-a122-f716e30c3c84 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.826143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.826757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.827019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.827282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.827902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.829836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.858168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1223/2456] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:40.862795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.873803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c60dd-c1fd-482d-a9a7-140144a54536 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.931262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.931868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.932139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.932400 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.933044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.935058 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.958201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1234/2457] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:40 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:40.962334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:40.972964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842206f-2666-4040-a7cc-cf3fcfb9e099 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:40.978114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:40.978721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:40.978989 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:40.979250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:40.979888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.981500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.993018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1224/2458] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:40.996910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.007195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b29a-cdf9-4c6c-b72d-5bbc10732e9d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.012840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7240-27f9-4d35-be4d-c32592f1b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.013585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7240-27f9-4d35-be4d-c32592f1b3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.013904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7240-27f9-4d35-be4d-c32592f1b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.014234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7240-27f9-4d35-be4d-c32592f1b3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.015166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7240-27f9-4d35-be4d-c32592f1b3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.017159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7240-27f9-4d35-be4d-c32592f1b3f8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.023481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:41.030546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1235/2459] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:41.034556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.059952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad6dac-1180-42d3-aded-4c175179bfea admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.064681 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.065450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.065718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.065992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] PATH_INFO: `/v3/projects/04bf3959e58348aca570c22362f09541/users/6e4bc33b9a6f483d99cd37736fd7f3bc/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.087036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bf3959e58348aca570c22362f09541, user_id=6e4bc33b9a6f483d99cd37736fd7f3bc, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.089830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.106907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1225/2460] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:41 2022] PUT /identity/v3/projects/04bf3959e58348aca570c22362f09541/users/6e4bc33b9a6f483d99cd37736fd7f3bc/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:41.119668 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.119965 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.120169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.150669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] MFA Rules not processed for user `6e4bc33b9a6f483d99cd37736fd7f3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:41.151874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:41.218116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1236/2461] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:41.222823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.275615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:41.288301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1d57a-44f4-4233-9492-a93a9acca271 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.293142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.293765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.294038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.294305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.294945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.296951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.331227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1226/2462] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:41 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:41.335681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.347530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be5d22-673c-42b8-847c-1087e5b0651b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.404352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.404950 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.405260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.405527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.406139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.408062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.437982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1237/2463] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:41 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:41.442773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.458473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609e5a-d5f8-43da-9f17-0e23fd200fe6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.463741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.464319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.464591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.464854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.465519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.467122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.478098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1227/2464] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:41.482505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.493311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24a60-3792-4f31-a4ec-dafe4ca70bc3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.497977 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.498626 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.498904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.499169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] PATH_INFO: `/v3/projects/5fa352d6b3bb40f1ad7f29d0dae7c5ad/users/71f888747dc94fdfb6e963a752ff85b6/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.514704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa352d6b3bb40f1ad7f29d0dae7c5ad, user_id=71f888747dc94fdfb6e963a752ff85b6, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.517425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.532659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1238/2465] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:41 2022] PUT /identity/v3/projects/5fa352d6b3bb40f1ad7f29d0dae7c5ad/users/71f888747dc94fdfb6e963a752ff85b6/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:41.537559 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.548791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d98117-f154-45bd-b0eb-df26d58fb223 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.606926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce0082-8d58-493d-b96f-a1493378b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.607532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce0082-8d58-493d-b96f-a1493378b8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.607807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce0082-8d58-493d-b96f-a1493378b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.608070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce0082-8d58-493d-b96f-a1493378b8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.608705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce0082-8d58-493d-b96f-a1493378b8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.610368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce0082-8d58-493d-b96f-a1493378b8cb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.620670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1228/2466] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:41.625073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.635750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300a9b8-146c-4b86-aa8f-7a75a9dc6d75 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.640846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.641534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.641804 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.642064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] PATH_INFO: `/v3/projects/5fa352d6b3bb40f1ad7f29d0dae7c5ad/users/71f888747dc94fdfb6e963a752ff85b6/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.644073 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa352d6b3bb40f1ad7f29d0dae7c5ad, user_id=71f888747dc94fdfb6e963a752ff85b6, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.646721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.656967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1239/2467] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:41 2022] PUT /identity/v3/projects/5fa352d6b3bb40f1ad7f29d0dae7c5ad/users/71f888747dc94fdfb6e963a752ff85b6/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:41.667657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.667970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.668246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.697694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] MFA Rules not processed for user `71f888747dc94fdfb6e963a752ff85b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:41.698901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:41.767941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1229/2468] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:41.779914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.825994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:41.842590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df6d95-2854-48ad-b92b-f306a91534ce admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.846226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.846826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.847101 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.847375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:41.859119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:41.860564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:41.870171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1240/2469] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:41.953744 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:41.964047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006d30-08b5-4d5e-9a4d-b9063aa04593 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:41.968302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:41.968901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:41.969212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:41.969554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:42.020171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:42.034293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:42.035761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:42.044628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1230/2470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:43.527177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:43.529203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:43.754087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb073fc1-39fc-4c26-a953-6eec65b04847 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:43.766379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:43.767016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:43.767286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:43.767547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:43.769642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:43.786870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:43.788345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d38234-6100-4e4f-8a1d-b1acbfef335e service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:43.804217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1241/2471] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:46.404787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:46.407264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:46.478854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462f7c8-07e8-4eb2-8602-57b2e5e84086 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:46.484512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:46.485176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:46.485446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:46.485706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] PATH_INFO: `/v3/users/29c013c2f0e949929758380f8ff6d29e` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:46.486912 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c013c2f0e949929758380f8ff6d29e)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:46.489231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:46.544194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c013c2f0e949929758380f8ff6d29e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:46.559421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c013c2f0e949929758380f8ff6d29e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:46.566318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c013c2f0e949929758380f8ff6d29e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:46.567042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c013c2f0e949929758380f8ff6d29e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:46.567653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c013c2f0e949929758380f8ff6d29e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:46.581593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1231/2472] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:46 2022] DELETE /identity/v3/users/29c013c2f0e949929758380f8ff6d29e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:46.586234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:46.586771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:46.586771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:46.605513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:46.606830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:46.669466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1242/2473] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:46.679950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:46.681600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:46.741617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d865ee-7790-49b0-b954-cd253d0fa1d9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:46.745631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd42e11-4757-4451-ad6e-711fe524f291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:46.746225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42e11-4757-4451-ad6e-711fe524f291 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:46.746497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42e11-4757-4451-ad6e-711fe524f291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:46.746757 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42e11-4757-4451-ad6e-711fe524f291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:46.755727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd42e11-4757-4451-ad6e-711fe524f291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:46.757203 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd42e11-4757-4451-ad6e-711fe524f291 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:46.766575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1232/2474] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:47.054003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.055371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.068320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c6493-e70b-4c14-9b41-f3afd796a934 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.074545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.075452 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.075940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.076209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] PATH_INFO: `/v3/projects/0a575b01088548dea937750d44bef8a4` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.078159 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a575b01088548dea937750d44bef8a4)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.080251 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.134186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a575b01088548dea937750d44bef8a4', 'request_id': 'req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:47.141212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a575b01088548dea937750d44bef8a4', 'request_id': 'req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:47.149874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a575b01088548dea937750d44bef8a4', 'request_id': 'req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:47.153827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:47.162269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] The token cache is being invalidate because project 0a575b01088548dea937750d44bef8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:47.162967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:47.164506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0f6fc0cc-248d-48fd-b426-0cf6eaa86429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:47.166201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1243/2475] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:47 2022] DELETE /identity/v3/projects/0a575b01088548dea937750d44bef8a4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:47.171351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.171637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.171896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.201698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:47.202918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.207249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:47.268464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1233/2476] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:47.277613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.277975 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.278270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.298859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:47.300098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.308874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1244/2477] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:47.313200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.323060 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e30b5-d3fb-4094-bcaf-926dd15a59c1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.329924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.330878 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.331160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.331426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.333206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:47.333513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.335508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.348659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1234/2478] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:16:47.353510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.362810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f5fcb-0874-48a3-b03f-451e0b6fa444 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.367973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.368560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.368834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.369131 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.369758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.371678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.403385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1245/2479] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:47.404620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.414602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8884-6bda-4860-8ae2-fef3c59cec79 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.470116 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.470714 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.470986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.471245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.471839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.473797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.498299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1235/2480] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:47.504426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.520166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698d16c-3cda-42b0-9f43-252c373aba8d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.526347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.526939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.527240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.527497 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.528128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.529769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.540072 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1246/2481] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:47.544188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.554577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5631a6-1336-4523-b05d-93678ff0a3ea admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.560654 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58376e-d28d-45ac-98dc-3f7a78cddf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.561273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58376e-d28d-45ac-98dc-3f7a78cddf9a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.561546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58376e-d28d-45ac-98dc-3f7a78cddf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.561808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58376e-d28d-45ac-98dc-3f7a78cddf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.562436 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58376e-d28d-45ac-98dc-3f7a78cddf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.564018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58376e-d28d-45ac-98dc-3f7a78cddf9a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.574921 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1236/2482] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:47.579041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.590139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24fd04-3615-4bd4-af1a-7ff4c25931e9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.595613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.596282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.596556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.596823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] PATH_INFO: `/v3/projects/9d3796ba90c941f48644716cdb629755/users/365d3ada31f447bc83a42392cf3f0ffa/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.613318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3796ba90c941f48644716cdb629755, user_id=365d3ada31f447bc83a42392cf3f0ffa, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.616527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.631798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1247/2483] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:47 2022] PUT /identity/v3/projects/9d3796ba90c941f48644716cdb629755/users/365d3ada31f447bc83a42392cf3f0ffa/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:47.642123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.642404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.642668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.669822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] MFA Rules not processed for user `365d3ada31f447bc83a42392cf3f0ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:47.671080 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.739846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1237/2484] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:47.744315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.805396 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d1b1-1045-428f-88aa-8975d29d2bb4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.810104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.810688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.810963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.811229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.811862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.813863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.847231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1248/2485] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:47.848469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.856289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:47.861112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520bf9e-7782-475c-aab9-1ed41134dada None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.920031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.920553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.920875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.921161 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.921780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.923695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.946001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1238/2486] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:47.950122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.961986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e1c6-3c14-4f6e-807d-2ed83e26edba admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.968106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.968697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.968997 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.969275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.969907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.971527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.983125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1249/2487] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:47.987544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.998974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0226a2-fd09-4423-bddb-58064ce2f0c2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:48.004290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:48.004943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:48.005260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:48.005604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] PATH_INFO: `/v3/projects/2e09bfd0809e48348bc626e486762f85/users/d1b4f933471f4b08a8a9d84ede47e02f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:48.023367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e09bfd0809e48348bc626e486762f85, user_id=d1b4f933471f4b08a8a9d84ede47e02f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:48.026079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:48.040310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1239/2488] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:47 2022] PUT /identity/v3/projects/2e09bfd0809e48348bc626e486762f85/users/d1b4f933471f4b08a8a9d84ede47e02f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:48.050246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:48.060830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9f578-99a4-4f73-a195-76b96e8cc251 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:48.120818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c43645-7623-40ca-a0c3-eb7ff8b881db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:48.121476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43645-7623-40ca-a0c3-eb7ff8b881db admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:48.121749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43645-7623-40ca-a0c3-eb7ff8b881db admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:48.122015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43645-7623-40ca-a0c3-eb7ff8b881db admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:48.122634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c43645-7623-40ca-a0c3-eb7ff8b881db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:48.124276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c43645-7623-40ca-a0c3-eb7ff8b881db admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:48.129684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:48.135207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1250/2489] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:48.139961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:48.150810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2cea6-e53c-463c-9bb3-3f6930cdae32 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:48.156610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:48.157293 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:48.157568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:48.157791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] PATH_INFO: `/v3/projects/2e09bfd0809e48348bc626e486762f85/users/d1b4f933471f4b08a8a9d84ede47e02f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:48.159767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e09bfd0809e48348bc626e486762f85, user_id=d1b4f933471f4b08a8a9d84ede47e02f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:48.162466 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:48.172548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1240/2490] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:48 2022] PUT /identity/v3/projects/2e09bfd0809e48348bc626e486762f85/users/d1b4f933471f4b08a8a9d84ede47e02f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:48.182662 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:48.182974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:48.183234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:48.211852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] MFA Rules not processed for user `d1b4f933471f4b08a8a9d84ede47e02f`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:48.213098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:48.292559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1251/2491] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:48.297641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:48.299433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:48.362435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad47bcf-bc27-4048-b7f5-a37681090a93 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:48.366987 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd3be9-6ee8-41eb-ab6c-9a0e263ea914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:48.367592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3be9-6ee8-41eb-ab6c-9a0e263ea914 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:48.368035 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3be9-6ee8-41eb-ab6c-9a0e263ea914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:48.368308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3be9-6ee8-41eb-ab6c-9a0e263ea914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:48.437279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd3be9-6ee8-41eb-ab6c-9a0e263ea914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:48.438636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd3be9-6ee8-41eb-ab6c-9a0e263ea914 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:48.447945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1241/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:49.050244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:49.051667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:49.121090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48252669-46e6-4d3a-8c60-1dbc89cd3f3e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:49.126286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:49.126919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:49.127193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:49.127503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] PATH_INFO: `/v3/users/6e4bc33b9a6f483d99cd37736fd7f3bc` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:49.128648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4bc33b9a6f483d99cd37736fd7f3bc)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:49.130618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:49.181363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4bc33b9a6f483d99cd37736fd7f3bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.190697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4bc33b9a6f483d99cd37736fd7f3bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.204002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4bc33b9a6f483d99cd37736fd7f3bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.204614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4bc33b9a6f483d99cd37736fd7f3bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.205268 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4bc33b9a6f483d99cd37736fd7f3bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.218255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1252/2493] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:49 2022] DELETE /identity/v3/users/6e4bc33b9a6f483d99cd37736fd7f3bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:49.223131 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:49.223413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:49.223690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:49.243534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:49.244723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:49.250139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:49.303643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1242/2494] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:49.313858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:49.315523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:49.323115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:49.383531 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a4c8-a28c-4208-8b75-a302a9f9c22a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:49.388130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:49.388730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:49.388994 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:49.389299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:49.399455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:49.400896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:49.410924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1253/2495] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:49.513515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:49.515248 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:49.527704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e61a5-6ac4-488e-b7ca-0bff72254c5f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:49.531362 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:49.531968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:49.532238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:49.532504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:49.534194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:49.546067 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:49.547599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:49.559616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1243/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:49.869113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:49.871112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:49.894071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8389f3-7871-4b04-828d-8c6d4dd18f5f service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:49.903371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:49.904588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:49.906041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:49.906252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] PATH_INFO: `/v3/projects/04bf3959e58348aca570c22362f09541` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:49.908071 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bf3959e58348aca570c22362f09541)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:49.911394 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:49.971870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bf3959e58348aca570c22362f09541', 'request_id': 'req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.978569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bf3959e58348aca570c22362f09541', 'request_id': 'req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:49.997680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bf3959e58348aca570c22362f09541', 'request_id': 'req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.008691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] The token cache is being invalidate because project 04bf3959e58348aca570c22362f09541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:50.009001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.009635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.011340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1254/2497] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:49 2022] DELETE /identity/v3/projects/04bf3959e58348aca570c22362f09541 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:50.015626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:50.025610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d94d3c-2e35-41a6-9286-66d0f56c27b2 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:50.083525 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:50.084165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.084462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.084861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] PATH_INFO: `/v3/users/71f888747dc94fdfb6e963a752ff85b6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.086375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f888747dc94fdfb6e963a752ff85b6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:50.089239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:50.146174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f888747dc94fdfb6e963a752ff85b6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.158180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f888747dc94fdfb6e963a752ff85b6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.166455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f888747dc94fdfb6e963a752ff85b6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.167275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f888747dc94fdfb6e963a752ff85b6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.168330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7d211a28-ea09-4df1-a69c-72ae9098fe7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f888747dc94fdfb6e963a752ff85b6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.183335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1244/2498] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:50 2022] DELETE /identity/v3/users/71f888747dc94fdfb6e963a752ff85b6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:50.458856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:50.460933 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:50.477173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0c1d-01fa-4842-8855-aa9c9cd7b491 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:50.553102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:50.553930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.554255 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.554585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] PATH_INFO: `/v3/projects/5fa352d6b3bb40f1ad7f29d0dae7c5ad` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.555900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa352d6b3bb40f1ad7f29d0dae7c5ad)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:50.558371 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:50.602946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:50.620814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa352d6b3bb40f1ad7f29d0dae7c5ad', 'request_id': 'req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.628246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa352d6b3bb40f1ad7f29d0dae7c5ad', 'request_id': 'req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.638040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa352d6b3bb40f1ad7f29d0dae7c5ad', 'request_id': 'req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.649212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] The token cache is being invalidate because project 5fa352d6b3bb40f1ad7f29d0dae7c5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:50.649574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.650136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-67c4fe15-bfa7-4c28-a90f-96f2d112cffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:50.652465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1255/2499] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:50 2022] DELETE /identity/v3/projects/5fa352d6b3bb40f1ad7f29d0dae7c5ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:50.657221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.657764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.657764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.681012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:50.682521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:50.697955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:50.751384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1245/2500] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:50.759290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.759760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.760100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.780814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:50.782169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:50.792438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1256/2501] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:50.797037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:50.813877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590117b-6e96-401d-b945-00c6cf621e60 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:50.819930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:50.820751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.821149 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.821614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.822341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:50.822737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:50.824433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:50.844162 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1246/2502] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:50.845862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:50.858696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319560a-e509-40f5-a2dc-baf26804f037 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:50.864215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:50.864839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.865196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.865465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.866145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:50.868108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:50.901659 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1257/2503] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:50 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:50.902830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:50.913862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582eae8-3841-4542-a56e-261ed9d64c41 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:50.974503 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:50.975126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.975396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.975656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.976283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:50.978242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.004789 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1247/2504] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:50 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:51.009120 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.020114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.022403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.023130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdc0c9-16ac-4920-a9ed-1ed71328e16c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.027981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.028589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.028857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.029176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.029832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.031429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.038729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e59dfa-6138-49be-b55f-a6dcd4b546d7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.042731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1258/2505] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:51.044346 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.045639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.046034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.046400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] PATH_INFO: `/v3/users/365d3ada31f447bc83a42392cf3f0ffa` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.046831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.047817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=365d3ada31f447bc83a42392cf3f0ffa)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.049941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.058134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796e176-020b-450b-b729-99ae305a5996 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.062960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.063593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.063871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.064139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.064796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.066431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.081122 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1259/2506] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:51.082750 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.094138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2564f-2f94-4924-8185-39bd97eec147 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.099165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e4a82-0139-4d7a-9169-c23d7b367509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.100726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4a82-0139-4d7a-9169-c23d7b367509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.101297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4a82-0139-4d7a-9169-c23d7b367509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.102896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4a82-0139-4d7a-9169-c23d7b367509 admin admin] PATH_INFO: `/v3/projects/1e1d45e77f654f0d87842e44b438513a/users/28c0a9d7badb4c1185ce63e4ab100f49/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.109792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365d3ada31f447bc83a42392cf3f0ffa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:51.121376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e4a82-0139-4d7a-9169-c23d7b367509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1d45e77f654f0d87842e44b438513a, user_id=28c0a9d7badb4c1185ce63e4ab100f49, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.126652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e4a82-0139-4d7a-9169-c23d7b367509 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.126806 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365d3ada31f447bc83a42392cf3f0ffa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:51.132925 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365d3ada31f447bc83a42392cf3f0ffa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:51.133810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365d3ada31f447bc83a42392cf3f0ffa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:51.134445 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d85c8f69-7115-4d62-a89b-9b9d8230a6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365d3ada31f447bc83a42392cf3f0ffa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:51.140320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1260/2507] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:51 2022] PUT /identity/v3/projects/1e1d45e77f654f0d87842e44b438513a/users/28c0a9d7badb4c1185ce63e4ab100f49/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:51.151093 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.151490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.151667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.156449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1248/2508] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:51 2022] DELETE /identity/v3/users/365d3ada31f447bc83a42392cf3f0ffa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:51.160728 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.161046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.161323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.173976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:51.185233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:51.186376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] MFA Rules not processed for user `28c0a9d7badb4c1185ce63e4ab100f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:51.186709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.187959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.247329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1249/2509] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:51.257883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.259362 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.260479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1261/2510] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:51.264730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.266129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.280532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136575e1-c173-40a2-a601-a4507cf45aac None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.285796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.286412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.286702 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.286957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.287610 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.289777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.326683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1262/2511] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:51 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:51.326910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e110e-804f-41d8-8a4b-72d4ca3f09b1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.328810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.347738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:51.402532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.403289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.403630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.403959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.410021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886726-d034-4558-874d-8bbed8964206 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.415949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.416354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.416823 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.417198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.417528 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.418435 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.418567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.420631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.450798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1263/2512] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:51 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:51.455431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.456865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1250/2513] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:51.471502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663a318-49ac-479a-bd85-91980e72a3ef admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.476854 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.477512 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.477788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.478056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.478706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.480434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.495529 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1264/2514] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:51.496791 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.507707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f2ac2-b712-4314-8a53-103f955e71a6 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.513085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.514304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.514585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.514978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] PATH_INFO: `/v3/projects/3bef9f3064f143e887418a98e73fc93d/users/466e78e0706f4f109cd98858728c8cb7/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.549620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bef9f3064f143e887418a98e73fc93d, user_id=466e78e0706f4f109cd98858728c8cb7, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.553336 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.573504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1251/2515] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:51 2022] PUT /identity/v3/projects/3bef9f3064f143e887418a98e73fc93d/users/466e78e0706f4f109cd98858728c8cb7/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:51.577721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.589631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234823f0-42e8-43d5-aa09-c16a7ef22a07 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.658402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19671992-9c9c-4e26-b443-5fe71f134f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.659837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19671992-9c9c-4e26-b443-5fe71f134f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.660148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19671992-9c9c-4e26-b443-5fe71f134f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.660473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19671992-9c9c-4e26-b443-5fe71f134f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.661223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19671992-9c9c-4e26-b443-5fe71f134f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.663640 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19671992-9c9c-4e26-b443-5fe71f134f82 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.677176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1265/2516] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:51.681133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.692267 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d7bf-e6aa-46fe-af77-bf9109cb441b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.697803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.698577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.699137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.699268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] PATH_INFO: `/v3/projects/3bef9f3064f143e887418a98e73fc93d/users/466e78e0706f4f109cd98858728c8cb7/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.701474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bef9f3064f143e887418a98e73fc93d, user_id=466e78e0706f4f109cd98858728c8cb7, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.704583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.717042 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1252/2517] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:51 2022] PUT /identity/v3/projects/3bef9f3064f143e887418a98e73fc93d/users/466e78e0706f4f109cd98858728c8cb7/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:51.727859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.728193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.728426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.774348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] MFA Rules not processed for user `466e78e0706f4f109cd98858728c8cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:51.776799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.798383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.800651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.868402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:51.885744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1266/2518] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:51.896784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:51.898238 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:51.915139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:51.921308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0527-2098-4782-8259-9470b3f3b72d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.927125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:51.927645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:51.927937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:51.928282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] PATH_INFO: `/v3/projects/9d3796ba90c941f48644716cdb629755` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:51.929494 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3796ba90c941f48644716cdb629755)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:51.931487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:51.972665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8745-1f17-4555-aa65-3bdd448e82fe None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:51.989804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3796ba90c941f48644716cdb629755', 'request_id': 'req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:51.999083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3796ba90c941f48644716cdb629755', 'request_id': 'req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.006292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3796ba90c941f48644716cdb629755', 'request_id': 'req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.019098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] The token cache is being invalidate because project 9d3796ba90c941f48644716cdb629755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:52.019384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.020055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.021690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1253/2519] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:51 2022] DELETE /identity/v3/projects/9d3796ba90c941f48644716cdb629755 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:52.025623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:52.026976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:52.034261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:52.034876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.035152 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.035451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:52.037722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:52.100053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b68e9-a3e0-4882-b0ef-89ffcf4216a5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:52.105910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:52.106588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.106864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.107136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] PATH_INFO: `/v3/users/d1b4f933471f4b08a8a9d84ede47e02f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:52.108274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b4f933471f4b08a8a9d84ede47e02f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:52.110234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:52.111807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:52.113276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:52.135744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1267/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:52.167064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b4f933471f4b08a8a9d84ede47e02f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.179471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:52.184715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b4f933471f4b08a8a9d84ede47e02f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.195811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b4f933471f4b08a8a9d84ede47e02f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.196690 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b4f933471f4b08a8a9d84ede47e02f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.197396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b4f933471f4b08a8a9d84ede47e02f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.214626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1254/2521] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:52 2022] DELETE /identity/v3/users/d1b4f933471f4b08a8a9d84ede47e02f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:52.584820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:52.604004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e01364-fdf9-4c24-9dba-98c08b97a022 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:52.673614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:52.676104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:52.676669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:52.677449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.677829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.678301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] PATH_INFO: `/v3/projects/2e09bfd0809e48348bc626e486762f85` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:52.680507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e09bfd0809e48348bc626e486762f85)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:52.682573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:52.691801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea650a2-30e6-454d-aabb-2ec9b9f23fee admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:52.718754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:52.719584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.719932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.720304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] PATH_INFO: `/v3/users/28c0a9d7badb4c1185ce63e4ab100f49` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:52.721303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:52.722518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c0a9d7badb4c1185ce63e4ab100f49)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:52.726316 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:52.767502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e09bfd0809e48348bc626e486762f85', 'request_id': 'req-5750250c-42cf-4d27-aeeb-e8857ef0104b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.777405 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e09bfd0809e48348bc626e486762f85', 'request_id': 'req-5750250c-42cf-4d27-aeeb-e8857ef0104b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.791328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e09bfd0809e48348bc626e486762f85', 'request_id': 'req-5750250c-42cf-4d27-aeeb-e8857ef0104b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.816805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] The token cache is being invalidate because project 2e09bfd0809e48348bc626e486762f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:52.817134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.818588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5750250c-42cf-4d27-aeeb-e8857ef0104b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.820379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1268/2522] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:52 2022] DELETE /identity/v3/projects/2e09bfd0809e48348bc626e486762f85 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:52.878180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c0a9d7badb4c1185ce63e4ab100f49'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.919022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c0a9d7badb4c1185ce63e4ab100f49'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.940103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c0a9d7badb4c1185ce63e4ab100f49'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.943612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c0a9d7badb4c1185ce63e4ab100f49'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.944580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c0a9d7badb4c1185ce63e4ab100f49'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:52.972618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1255/2523] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:52 2022] DELETE /identity/v3/users/28c0a9d7badb4c1185ce63e4ab100f49 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:52.974767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.975294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.976040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.003017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:53.004517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.080917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1269/2524] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:53.088506 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:53.090389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.164107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c974-9bad-4749-9c5e-f20c14f64d89 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:53.169251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:53.169880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.170158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.170430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.181532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:53.183164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:53.201754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1256/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:53.339692 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:53.341244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.354768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672654a3-41f7-4d75-b4d9-7136191e6b14 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:53.359569 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:53.360305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.360664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.361016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] PATH_INFO: `/v3/users/95398f8ac1ca42c0969b37f54a582e65` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.362221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95398f8ac1ca42c0969b37f54a582e65)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:53.364631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:53.417412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95398f8ac1ca42c0969b37f54a582e65'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.425539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95398f8ac1ca42c0969b37f54a582e65'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.438099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95398f8ac1ca42c0969b37f54a582e65'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.438755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95398f8ac1ca42c0969b37f54a582e65'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.439338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95398f8ac1ca42c0969b37f54a582e65'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.454454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1270/2526] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:53 2022] DELETE /identity/v3/users/95398f8ac1ca42c0969b37f54a582e65 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:53.514453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:53.516179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.530782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce8d9-ed84-4d38-b557-bd3f2dd96774 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:53.581862 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:53.592499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:53.593117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.593570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.594014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] PATH_INFO: `/v3/projects/1e1d45e77f654f0d87842e44b438513a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.595415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1d45e77f654f0d87842e44b438513a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:53.597440 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:53.633911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:53.635703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.654703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1d45e77f654f0d87842e44b438513a', 'request_id': 'req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.659357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec154-fdf2-44f1-81ae-ba509fc3564b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:53.664927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1d45e77f654f0d87842e44b438513a', 'request_id': 'req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.671869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1d45e77f654f0d87842e44b438513a', 'request_id': 'req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.680003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:53.683012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] The token cache is being invalidate because project 1e1d45e77f654f0d87842e44b438513a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:53.683369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.684031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.685551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1257/2527] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:53 2022] DELETE /identity/v3/projects/1e1d45e77f654f0d87842e44b438513a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:53.690013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:53.691500 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.723317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:53.723947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.724218 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.724477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] PATH_INFO: `/v3/projects/467786e761c74fb8a9822ecbaa3f4142` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.725675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467786e761c74fb8a9822ecbaa3f4142)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:53.727741 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:53.757666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47b4a-8bbe-4c1c-a941-9caa10d6fca8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:53.762703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:53.763338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.763628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.763880 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] PATH_INFO: `/v3/users/466e78e0706f4f109cd98858728c8cb7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.765018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=466e78e0706f4f109cd98858728c8cb7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:53.766975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:53.775675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467786e761c74fb8a9822ecbaa3f4142', 'request_id': 'req-7da7708c-b6e6-4ebd-a6da-0b300b596a63'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.781731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467786e761c74fb8a9822ecbaa3f4142', 'request_id': 'req-7da7708c-b6e6-4ebd-a6da-0b300b596a63'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.790412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467786e761c74fb8a9822ecbaa3f4142', 'request_id': 'req-7da7708c-b6e6-4ebd-a6da-0b300b596a63'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.804248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] The token cache is being invalidate because project 467786e761c74fb8a9822ecbaa3f4142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:53.804539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.805304 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7da7708c-b6e6-4ebd-a6da-0b300b596a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.806924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1271/2528] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:53 2022] DELETE /identity/v3/projects/467786e761c74fb8a9822ecbaa3f4142 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:53.811842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.812126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.812414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.818164 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466e78e0706f4f109cd98858728c8cb7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.831686 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466e78e0706f4f109cd98858728c8cb7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.832069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:53.833496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.838522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466e78e0706f4f109cd98858728c8cb7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.839594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466e78e0706f4f109cd98858728c8cb7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.840214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f964ec1a-f4b1-4795-9605-278bc23ee32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466e78e0706f4f109cd98858728c8cb7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:53.855235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1258/2529] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:53 2022] DELETE /identity/v3/users/466e78e0706f4f109cd98858728c8cb7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:53.898701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1272/2530] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:53.906603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.906903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.907152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.917054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:53.929081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:53.931495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.993013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1259/2531] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:53.997362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.007514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeb635-4022-4080-bf46-f85bdbb66624 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.013507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.014138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.014718 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.014851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.015776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:54.016567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.017911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.031445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1273/2532] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:54.035835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.045498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f1e95-5a8b-430e-b69c-2cc3bbb184ab None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.050074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.050677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.050948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.051212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.051845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.054028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.088655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1260/2533] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:54.093522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.104401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f933-c11f-4aa2-9561-2be5c91c251a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.148065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.150598 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.154057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:54.182158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.182916 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.183276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.183633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.184328 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.186454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.209020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1274/2534] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:54.212688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.222387 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34f145-ef3c-43b5-8e8e-1ff15d3f22ec admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.227402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.227746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.228020 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.228289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.228927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.230548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.231277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfce2ac-5dfe-4804-b957-5c02056663cf admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.236962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.237628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.237903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.238167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] PATH_INFO: `/v3/projects/3bef9f3064f143e887418a98e73fc93d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.239645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bef9f3064f143e887418a98e73fc93d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.241649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.244961 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1275/2535] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:16:54.246076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.258034 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05256-a9a5-4556-a5b7-6fc0c762beb9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.262612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.263214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.263490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.263754 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.264393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.266144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.277076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1276/2536] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:54.281256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.291294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab601-c3cc-4f34-abe2-043461530e99 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.293396 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bef9f3064f143e887418a98e73fc93d', 'request_id': 'req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:54.301979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bef9f3064f143e887418a98e73fc93d', 'request_id': 'req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:54.308655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bef9f3064f143e887418a98e73fc93d', 'request_id': 'req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:54.319741 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] The token cache is being invalidate because project 3bef9f3064f143e887418a98e73fc93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:54.320028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:54.320694 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3f39c764-2f74-4e1f-8b8a-3adfad3eac00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:54.322301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1261/2537] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:54 2022] DELETE /identity/v3/projects/3bef9f3064f143e887418a98e73fc93d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:54.327073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420aff2-ca00-41a3-b58b-e75425d3d757 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.327548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420aff2-ca00-41a3-b58b-e75425d3d757 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.327902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420aff2-ca00-41a3-b58b-e75425d3d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.347879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c420aff2-ca00-41a3-b58b-e75425d3d757 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:54.349103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c420aff2-ca00-41a3-b58b-e75425d3d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.349289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab94392-64ed-4a86-bf0a-114989665306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.349946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab94392-64ed-4a86-bf0a-114989665306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.350282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab94392-64ed-4a86-bf0a-114989665306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.350553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab94392-64ed-4a86-bf0a-114989665306 admin admin] PATH_INFO: `/v3/projects/4ac89e29296540eb9c2e89f919baff92/users/16b0a51679244b51aee4ff506e20ba1e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.358028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1262/2538] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:54.366976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.367256 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.367524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.367976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab94392-64ed-4a86-bf0a-114989665306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac89e29296540eb9c2e89f919baff92, user_id=16b0a51679244b51aee4ff506e20ba1e, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.370695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab94392-64ed-4a86-bf0a-114989665306 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.375970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:54.385680 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1277/2539] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:54 2022] PUT /identity/v3/projects/4ac89e29296540eb9c2e89f919baff92/users/16b0a51679244b51aee4ff506e20ba1e/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:54.389602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:54.391443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.395910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.396195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.396466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.423384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] MFA Rules not processed for user `16b0a51679244b51aee4ff506e20ba1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:54.424580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.454303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1263/2540] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:54.455330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.464097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe57015-f623-4ebf-a36c-109cb378dadf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.468766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.469381 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.469683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.469943 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.470579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:54.470869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.472459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.484391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1264/2541] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:16:54.488922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.490466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1278/2542] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:54.494748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.496113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.498841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409b778-e090-4697-b141-d14ea188a679 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.503247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.503823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.504096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.504354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.504952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.506928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.509402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b9e1-4f97-476c-82a4-191ea5f05562 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.513843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.514429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.514703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.514967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.515616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.517536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.534698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1265/2543] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:54.538118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:54.539029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.549292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1279/2544] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:54.550252 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.605592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fa933-7e5c-41d1-ba91-c69a4de4cb09 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.611191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.611746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a263d9-ef58-4699-a2b0-8ac1a30c6f62 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.611871 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.612058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.612383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.612966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.615292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.616733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.617364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.617635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.617956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.618510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.620412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.641028 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1266/2545] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:54.641976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.644930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1280/2546] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:54.646008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.652137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cefdf-ed95-4678-80bf-b8e868efb210 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.655540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c736458-9356-4266-9d50-f5f7948f2a47 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.656924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.657544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.657811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.658074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.658844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.660447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.660619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.661085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.661362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.661628 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.662714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.664713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.670786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1267/2547] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:54.674803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.675791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1281/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:54.679773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.685331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ee32-37a6-4671-ba30-faf62ffb96f6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.689688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfd682-7c2e-4806-8612-700baf06b42f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.689954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.690516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.690794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.691052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.691809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.693507 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.694245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.694877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.695146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.695408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] PATH_INFO: `/v3/projects/0332ea1e9565457da08821f8ccc0a8a3/users/fc9b34c7c3a14814a6ea39b9defe1020/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.704233 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1268/2549] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:16:54.708365 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.711642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0332ea1e9565457da08821f8ccc0a8a3, user_id=fc9b34c7c3a14814a6ea39b9defe1020, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.714397 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.718318 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50927-b8a8-4d55-9630-8f703477368c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.723531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281d3f-4e14-4b90-90fc-3c8556541411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.724259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281d3f-4e14-4b90-90fc-3c8556541411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.724631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281d3f-4e14-4b90-90fc-3c8556541411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.724998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281d3f-4e14-4b90-90fc-3c8556541411 admin admin] PATH_INFO: `/v3/projects/f8420911841242b6aee0c0d1fc5e24ad/users/00430d671db24c6685ea4fffa90c57fa/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.730175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1282/2550] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:54 2022] PUT /identity/v3/projects/0332ea1e9565457da08821f8ccc0a8a3/users/fc9b34c7c3a14814a6ea39b9defe1020/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:54.734590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.741222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00281d3f-4e14-4b90-90fc-3c8556541411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8420911841242b6aee0c0d1fc5e24ad, user_id=00430d671db24c6685ea4fffa90c57fa, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.743864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00281d3f-4e14-4b90-90fc-3c8556541411 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.759581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1269/2551] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:54 2022] PUT /identity/v3/projects/f8420911841242b6aee0c0d1fc5e24ad/users/00430d671db24c6685ea4fffa90c57fa/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:54.770173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.770571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.770842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.795755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:54.799907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] MFA Rules not processed for user `00430d671db24c6685ea4fffa90c57fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:54.802093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.804189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c33c8-c821-415a-9432-bd24d2298512 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.862215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.862932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.863215 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.863483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.864489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.866223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.867556 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:54.871586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1270/2552] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:54.876447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.881307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1283/2553] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:54.882318 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.886893 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825dcb0-d6e5-4ea7-9c25-6609e42b1f6b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.891464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.891992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.892259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.892384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a718-783c-4dd2-a4ea-9be83c1c8d4e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.892519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.893421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.895206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.897909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74089d-74ce-458f-a9a8-a0167f3f71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.898601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74089d-74ce-458f-a9a8-a0167f3f71fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.898837 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74089d-74ce-458f-a9a8-a0167f3f71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.899135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74089d-74ce-458f-a9a8-a0167f3f71fc admin admin] PATH_INFO: `/v3/projects/0332ea1e9565457da08821f8ccc0a8a3/users/fc9b34c7c3a14814a6ea39b9defe1020/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.901233 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74089d-74ce-458f-a9a8-a0167f3f71fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0332ea1e9565457da08821f8ccc0a8a3, user_id=fc9b34c7c3a14814a6ea39b9defe1020, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:54.904129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74089d-74ce-458f-a9a8-a0167f3f71fc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:54.916080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1284/2554] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:54 2022] PUT /identity/v3/projects/0332ea1e9565457da08821f8ccc0a8a3/users/fc9b34c7c3a14814a6ea39b9defe1020/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:54.924094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1271/2555] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:54.928850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:54.929468 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678658-1618-4638-adff-c37e7dead8ee None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.929757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678658-1618-4638-adff-c37e7dead8ee None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.930067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678658-1618-4638-adff-c37e7dead8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.961944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-83678658-1618-4638-adff-c37e7dead8ee None None] MFA Rules not processed for user `fc9b34c7c3a14814a6ea39b9defe1020`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:54.964036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-83678658-1618-4638-adff-c37e7dead8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:54.992303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c38501-2c0d-4ee2-8aff-9e64e5ae9640 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:54.997952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:54.998797 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:54.999073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:54.999329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:54.999949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.002304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.024512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1272/2556] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:55.028570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.032918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1285/2557] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:55.038802 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7632-e897-4015-ad68-483e89754207 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.043416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.043567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678658-1618-4638-adff-c37e7dead8ee None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.044061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.044296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.044558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.044947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-83678658-1618-4638-adff-c37e7dead8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:55.045220 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.046788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.056780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1273/2558] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:16:55.060824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.070087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4bd51-6e4e-4fe2-a8b0-e77d0edf6be9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.074538 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.075146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.075420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.075680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] PATH_INFO: `/v3/projects/770bc14f8b3440458f70f02a58151934/users/c82ef8fe9d8841f8a9b557942485b8e4/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.090523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770bc14f8b3440458f70f02a58151934, user_id=c82ef8fe9d8841f8a9b557942485b8e4, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.093313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.103633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678658-1618-4638-adff-c37e7dead8ee None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.106949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1274/2559] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:55 2022] PUT /identity/v3/projects/770bc14f8b3440458f70f02a58151934/users/c82ef8fe9d8841f8a9b557942485b8e4/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:55.110962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.151685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:55.156348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.157027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.157292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.157579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.175946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa1123-e70c-4f29-b846-33e009bb4142 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.181250 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.181852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.182138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.182400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.183034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.184623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.194964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1275/2560] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:55.195747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:55.199234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.208746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e3bbd-541a-4465-87a8-b30b9b6b0c8b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.213326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b62af-99dc-4708-8f18-5f6d7dfb534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.213957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b62af-99dc-4708-8f18-5f6d7dfb534f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.214227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b62af-99dc-4708-8f18-5f6d7dfb534f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.214517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b62af-99dc-4708-8f18-5f6d7dfb534f admin admin] PATH_INFO: `/v3/projects/770bc14f8b3440458f70f02a58151934/users/c82ef8fe9d8841f8a9b557942485b8e4/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.216353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b62af-99dc-4708-8f18-5f6d7dfb534f admin admin] RBAC: Authorizing `identity:create_grant(project_id=770bc14f8b3440458f70f02a58151934, user_id=c82ef8fe9d8841f8a9b557942485b8e4, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.218995 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b62af-99dc-4708-8f18-5f6d7dfb534f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.219354 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.220793 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.229638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1276/2561] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:55 2022] PUT /identity/v3/projects/770bc14f8b3440458f70f02a58151934/users/c82ef8fe9d8841f8a9b557942485b8e4/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:55.230408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1286/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:55.240458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.240660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.240931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.269384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] MFA Rules not processed for user `c82ef8fe9d8841f8a9b557942485b8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:55.270592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:55.346044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1277/2563] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:55.357834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.367559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711ecc-2b64-43d1-a792-a5882366edea service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.417827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.418351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.418624 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.418889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.430615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.430615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.440128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1287/2564] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:55.520414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.531931 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549f77-be52-40e7-ab4e-de0112cb5420 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.535858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0f39-0b85-4e17-8f16-9cccd0c114d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.536597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0f39-0b85-4e17-8f16-9cccd0c114d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.536873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0f39-0b85-4e17-8f16-9cccd0c114d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.537172 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0f39-0b85-4e17-8f16-9cccd0c114d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.598546 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a0f39-0b85-4e17-8f16-9cccd0c114d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.600002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a0f39-0b85-4e17-8f16-9cccd0c114d7 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.609477 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1278/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:56.640467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:56.723818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562b7a8-fa14-40ed-9a71-14ffc008d868 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:56.728847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:56.729506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:56.729776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:56.730042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] PATH_INFO: `/v3/users/16b0a51679244b51aee4ff506e20ba1e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:56.731257 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b0a51679244b51aee4ff506e20ba1e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:56.733187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:56.790590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b0a51679244b51aee4ff506e20ba1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:56.794416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b0a51679244b51aee4ff506e20ba1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:56.808177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b0a51679244b51aee4ff506e20ba1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:56.808938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b0a51679244b51aee4ff506e20ba1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:56.809782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b0a51679244b51aee4ff506e20ba1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:56.815474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:56.826894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1288/2566] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:56 2022] DELETE /identity/v3/users/16b0a51679244b51aee4ff506e20ba1e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:56.830091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:56.830609 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:56.830708 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:56.850840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:56.852421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:56.899124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:56.928718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1279/2567] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:56.941114 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:56.942642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:57.004351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934ec9d-2577-4450-a8e5-f559fdb20aa5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:57.008745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:57.009388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:57.009666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:57.009926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:57.020380 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:57.022007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:57.032220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1289/2568] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:57.325563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:57.327274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:57.340635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db15cb4-3f27-40ba-a631-4ea63897eaf7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:57.346040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:57.349006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:57.349006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:57.349006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] PATH_INFO: `/v3/projects/4ac89e29296540eb9c2e89f919baff92` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:57.349006 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac89e29296540eb9c2e89f919baff92)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:57.350532 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:57.407579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac89e29296540eb9c2e89f919baff92', 'request_id': 'req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.415319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac89e29296540eb9c2e89f919baff92', 'request_id': 'req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.422284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac89e29296540eb9c2e89f919baff92', 'request_id': 'req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.434548 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] The token cache is being invalidate because project 4ac89e29296540eb9c2e89f919baff92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:57.434831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.435476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.437053 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1280/2569] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:57 2022] DELETE /identity/v3/projects/4ac89e29296540eb9c2e89f919baff92 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:57.441128 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:57.451261 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f3548-ae98-4db1-9460-d3f5dd4b8ae7 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:57.511909 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:57.512437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:57.512708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:57.513000 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] PATH_INFO: `/v3/users/fc9b34c7c3a14814a6ea39b9defe1020` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:57.514175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9b34c7c3a14814a6ea39b9defe1020)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:57.516088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:57.562419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9b34c7c3a14814a6ea39b9defe1020'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.570004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9b34c7c3a14814a6ea39b9defe1020'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.581545 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9b34c7c3a14814a6ea39b9defe1020'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.582214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9b34c7c3a14814a6ea39b9defe1020'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.582866 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-27584da6-bccf-4e5f-a270-227a0aa92d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9b34c7c3a14814a6ea39b9defe1020'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:57.596132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1290/2570] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:57 2022] DELETE /identity/v3/users/fc9b34c7c3a14814a6ea39b9defe1020 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:57.885048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:57.886547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:57.900510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6043e0-cc6c-4645-8acc-bb8a1a7f514d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:57.963747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:57.964369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:57.964640 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:57.964901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] PATH_INFO: `/v3/projects/0332ea1e9565457da08821f8ccc0a8a3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:57.966070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0332ea1e9565457da08821f8ccc0a8a3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:57.967974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.016903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0332ea1e9565457da08821f8ccc0a8a3', 'request_id': 'req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.025225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0332ea1e9565457da08821f8ccc0a8a3', 'request_id': 'req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.031353 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0332ea1e9565457da08821f8ccc0a8a3', 'request_id': 'req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.036048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:58.043082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] The token cache is being invalidate because project 0332ea1e9565457da08821f8ccc0a8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:58.043405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.044174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5d2dd70e-d5dc-474e-901e-92f7f26bfc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.045774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1281/2571] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:57 2022] DELETE /identity/v3/projects/0332ea1e9565457da08821f8ccc0a8a3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:58.050773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.051247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.051247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.070811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:58.071986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.084445 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:58.135539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1291/2572] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:58.143498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.143784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.144041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.164009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:58.165229 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.174122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1282/2573] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:58.178306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.190169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87fda5-f8c5-47f7-9e95-1ea5b0d99d13 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.197115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.197708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.197976 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.198236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.198870 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:58.199163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.200737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.212586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1292/2574] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:58.216831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.226614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e3ae7-baa3-4d91-a8cf-22f4e66205a2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.232892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.233520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.233794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.234043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.234653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.236570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.272117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1283/2575] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:58.273892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.286757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f1408-2e15-4fc0-bb63-1143b283e16e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.348418 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.348638 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.348810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.349234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.349861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.351850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.381136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1293/2576] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:16:58.388948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.392267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.395454 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.399817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab9ff5-e4ad-4182-9861-654959d65fab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.404422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.405048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.405351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.405585 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.406254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.407886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.409457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737855-0e9a-4957-9eae-3599837757c2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.414983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.415619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.415896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.416161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] PATH_INFO: `/v3/users/00430d671db24c6685ea4fffa90c57fa` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.423001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00430d671db24c6685ea4fffa90c57fa)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.423185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1284/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:58.423312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.424182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.433952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeff98-d62c-4973-b25c-b4a0474794cd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.440328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.441084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.441351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.441614 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.442259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.443858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.454887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1285/2578] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:16:58.459212 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.468920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2dc10-269f-4c4a-8c2b-736d7613c7b1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.470605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00430d671db24c6685ea4fffa90c57fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.473441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3ced-48b7-45c3-b126-73b36f0d3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.474294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3ced-48b7-45c3-b126-73b36f0d3517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.474429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3ced-48b7-45c3-b126-73b36f0d3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.474596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3ced-48b7-45c3-b126-73b36f0d3517 admin admin] PATH_INFO: `/v3/projects/f15c7cf102f34795a2db9a8d75c74455/users/e98d048f8c0a4f6d9896a3cea795b282/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.478422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00430d671db24c6685ea4fffa90c57fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.491084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00430d671db24c6685ea4fffa90c57fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.491409 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3ced-48b7-45c3-b126-73b36f0d3517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15c7cf102f34795a2db9a8d75c74455, user_id=e98d048f8c0a4f6d9896a3cea795b282, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.491745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00430d671db24c6685ea4fffa90c57fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.492347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-9e01c8c1-223e-489a-af9e-6ccfb89cbb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00430d671db24c6685ea4fffa90c57fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:58.494130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3ced-48b7-45c3-b126-73b36f0d3517 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.506119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1294/2579] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:58 2022] DELETE /identity/v3/users/00430d671db24c6685ea4fffa90c57fa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:58.508567 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1286/2580] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:58 2022] PUT /identity/v3/projects/f15c7cf102f34795a2db9a8d75c74455/users/e98d048f8c0a4f6d9896a3cea795b282/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:58.511688 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.512116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.512538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.524508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.524794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.525113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.530198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:58.537924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:58.539767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.553969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] MFA Rules not processed for user `e98d048f8c0a4f6d9896a3cea795b282`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:58.555177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.597284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1295/2581] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:58.607366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.608685 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.620206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1287/2582] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:58.624301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.625576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.639015 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b35da-9c3f-4b67-a23e-d4457d545682 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.643549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.644141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.644419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.644685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.645389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.647357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.668201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208c6a4-d8f4-4f68-ba23-ddd8c33b2397 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.672193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.672799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.673103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.673430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.674678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1288/2583] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:58.678680 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.683045 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.684480 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.694105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1296/2584] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:58.727034 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:58.743191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65ad2-e672-471e-96ca-7c822e9ebb1a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.749341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.750102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.750408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.750706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.751347 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.753355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.776958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1289/2585] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:16:58 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:16:58.781156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.791224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d088-ed12-4593-97f6-582938de2da1 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.795790 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.796469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.796742 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.797117 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.797755 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.799389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.810987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1297/2586] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:58.815283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.825402 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4046d12-cb4e-4883-9333-22a99c5df485 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.829991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.830641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.830916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.831321 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] PATH_INFO: `/v3/projects/c189794721ab4462a3585528bc8f9ffa/users/5b409ebc7ab34b21bbf813627cc8ce5f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.847645 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c189794721ab4462a3585528bc8f9ffa, user_id=5b409ebc7ab34b21bbf813627cc8ce5f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.850801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.872338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1290/2587] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:58 2022] PUT /identity/v3/projects/c189794721ab4462a3585528bc8f9ffa/users/5b409ebc7ab34b21bbf813627cc8ce5f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:58.876323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.887031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449412e-f502-48a4-b24e-9ffa52c3ad02 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.945103 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.945706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.945981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.946247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.946891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.948505 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.958797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1298/2588] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:16:58.963019 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.973517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379a98c-a8e8-4f1d-9261-427a402a6376 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.979284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc51c99-f515-44d7-adf1-f23bc8f65d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.979950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51c99-f515-44d7-adf1-f23bc8f65d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.980218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51c99-f515-44d7-adf1-f23bc8f65d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.980483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51c99-f515-44d7-adf1-f23bc8f65d6c admin admin] PATH_INFO: `/v3/projects/c189794721ab4462a3585528bc8f9ffa/users/5b409ebc7ab34b21bbf813627cc8ce5f/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.982587 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc51c99-f515-44d7-adf1-f23bc8f65d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c189794721ab4462a3585528bc8f9ffa, user_id=5b409ebc7ab34b21bbf813627cc8ce5f, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.985384 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc51c99-f515-44d7-adf1-f23bc8f65d6c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.990305 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.992095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.002122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1291/2589] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:16:58 2022] PUT /identity/v3/projects/c189794721ab4462a3585528bc8f9ffa/users/5b409ebc7ab34b21bbf813627cc8ce5f/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:59.012811 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.013197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.013530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.013800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874f98f-8e15-4e91-afab-a10e8922633d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:59.042191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] MFA Rules not processed for user `5b409ebc7ab34b21bbf813627cc8ce5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:59.043403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.048665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:59.074546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:59.075414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.075782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.076149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] PATH_INFO: `/v3/projects/f8420911841242b6aee0c0d1fc5e24ad` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.077820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8420911841242b6aee0c0d1fc5e24ad)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:59.079904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:59.114517 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1292/2590] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:59.125641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:59.127098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.129076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8420911841242b6aee0c0d1fc5e24ad', 'request_id': 'req-7a82c213-edf9-47fe-af06-0be2d7951e9f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.135630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8420911841242b6aee0c0d1fc5e24ad', 'request_id': 'req-7a82c213-edf9-47fe-af06-0be2d7951e9f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.144201 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8420911841242b6aee0c0d1fc5e24ad', 'request_id': 'req-7a82c213-edf9-47fe-af06-0be2d7951e9f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.154732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] The token cache is being invalidate because project f8420911841242b6aee0c0d1fc5e24ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:59.155017 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.155647 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.157395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1299/2591] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:58 2022] DELETE /identity/v3/projects/f8420911841242b6aee0c0d1fc5e24ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:59.161317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:59.162698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.185593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de90a5-ac11-46a0-a1cd-cce69a1bf9a9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:59.224099 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:59.226782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c213-edf9-47fe-af06-0be2d7951e9f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:59.232333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:59.233094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.233367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.233630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] PATH_INFO: `/v3/users/c82ef8fe9d8841f8a9b557942485b8e4` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.233748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:59.234350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.234619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.234847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82ef8fe9d8841f8a9b557942485b8e4)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:59.234953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.236652 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.236765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:59.283266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82ef8fe9d8841f8a9b557942485b8e4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.291384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82ef8fe9d8841f8a9b557942485b8e4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.298055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:59.299514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:59.302013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:59.304618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82ef8fe9d8841f8a9b557942485b8e4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.305649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82ef8fe9d8841f8a9b557942485b8e4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.306820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c0bc1042-d42f-4556-9796-6c97cb98f1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82ef8fe9d8841f8a9b557942485b8e4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.308828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1293/2592] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:59.320395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1300/2593] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:16:59 2022] DELETE /identity/v3/users/c82ef8fe9d8841f8a9b557942485b8e4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:16:59.631277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:59.649453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e67f00-f7a3-48e8-bfe3-422eaea56b66 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:59.708706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:59.709363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.709666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.709935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] PATH_INFO: `/v3/projects/770bc14f8b3440458f70f02a58151934` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.711121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770bc14f8b3440458f70f02a58151934)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:59.713108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:59.762177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770bc14f8b3440458f70f02a58151934', 'request_id': 'req-9cbf0baa-d429-4095-8591-ee2e3cea40d7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.770729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770bc14f8b3440458f70f02a58151934', 'request_id': 'req-9cbf0baa-d429-4095-8591-ee2e3cea40d7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.777127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770bc14f8b3440458f70f02a58151934', 'request_id': 'req-9cbf0baa-d429-4095-8591-ee2e3cea40d7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.787828 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] The token cache is being invalidate because project 770bc14f8b3440458f70f02a58151934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:16:59.788110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.788748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9cbf0baa-d429-4095-8591-ee2e3cea40d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:16:59.790265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1294/2594] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:16:59 2022] DELETE /identity/v3/projects/770bc14f8b3440458f70f02a58151934 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:16:59.795349 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.795633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.795906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.819990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:59.821250 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.883655 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1301/2595] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:59.891865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.892085 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.892357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.912222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:59.913510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:59.921277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1295/2596] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:59.925525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:59.935502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e068-c6d8-4bd9-ba2a-10366a901531 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:59.940585 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:59.941192 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.941467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.941733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.942375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:16:59.942674 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:59.944266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:59.955725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1302/2597] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:16:59.960401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:59.969630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80c350-cfd8-46fa-b9f2-4922ce78d65f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:59.974738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:59.975352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:59.975624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:59.975888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:59.976512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:59.978427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.005092 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:00.016465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1296/2598] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:16:59 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:00.021663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.032182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733eb5c-7161-42c9-ac27-a8e5e74cee31 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.090738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.091399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.091614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.091877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.092499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.094462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.117995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1303/2599] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:00 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:00.122290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.136399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a838188-247b-419e-b8a2-6ab8731d492b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.142022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.142544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.142839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.143120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.143783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.145393 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.155331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1297/2600] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:00.159559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.170395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873be7ed-72cf-4b3a-9152-95fbc72cbd2b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.175929 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c436-25f9-4aca-ae3a-aee31586402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.176513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c436-25f9-4aca-ae3a-aee31586402d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.176780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c436-25f9-4aca-ae3a-aee31586402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.177066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c436-25f9-4aca-ae3a-aee31586402d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.177704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76c436-25f9-4aca-ae3a-aee31586402d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.179474 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76c436-25f9-4aca-ae3a-aee31586402d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.190193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1304/2601] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:00.194465 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.205371 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad03b5-0de7-4982-8ca0-24ed6be4db21 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.210505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.211165 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.211443 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.211716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] PATH_INFO: `/v3/projects/3e4e8cfac87b485ebebfdaeabbaa3627/users/9f7079da7110401184dd33e377bb6f5d/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.226631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4e8cfac87b485ebebfdaeabbaa3627, user_id=9f7079da7110401184dd33e377bb6f5d, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.230273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.245918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1298/2602] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:00 2022] PUT /identity/v3/projects/3e4e8cfac87b485ebebfdaeabbaa3627/users/9f7079da7110401184dd33e377bb6f5d/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:00.256530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.256810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.257112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.285138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] MFA Rules not processed for user `9f7079da7110401184dd33e377bb6f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:00.286373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:00.327944 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:00.354319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1305/2603] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:00.358999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.429020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063f006-56be-4e2b-a24e-30689f22aee6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.437411 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.438246 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.438586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.438930 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.439901 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.442942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.472068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1299/2604] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:00 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:00.476537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.488002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf337d7-50fd-4e9c-a3d4-96e6eb8cca03 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.545825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.546419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.546713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.546968 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.547581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.549538 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.572530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1306/2605] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:00 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:00.576464 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.586874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86df0d-c777-4f98-92d5-283e236c754c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.592751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.593380 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.593656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.593919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.594606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.596185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.607530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1300/2606] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:00.611788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.623088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57a7a9-e0e1-41ed-b078-0857a213bf50 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.629892 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.630564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.630833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.631105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] PATH_INFO: `/v3/projects/1b67e0ac5f4743ca8b0899f943cdadf4/users/3feba8dbc2c14fb9afb64501b1de5435/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.647807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b67e0ac5f4743ca8b0899f943cdadf4, user_id=3feba8dbc2c14fb9afb64501b1de5435, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.650665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.665063 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1307/2607] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:00 2022] PUT /identity/v3/projects/1b67e0ac5f4743ca8b0899f943cdadf4/users/3feba8dbc2c14fb9afb64501b1de5435/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:00.669158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.679984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaacbfc-4cd4-441f-a3a8-d552fd2fa4e4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.740148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb49f2-5d7a-44bb-ad1a-092c7626aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.740867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb49f2-5d7a-44bb-ad1a-092c7626aeda admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.741243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb49f2-5d7a-44bb-ad1a-092c7626aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.741452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb49f2-5d7a-44bb-ad1a-092c7626aeda admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.742139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb49f2-5d7a-44bb-ad1a-092c7626aeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.743693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb49f2-5d7a-44bb-ad1a-092c7626aeda admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.757748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1301/2608] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:00.758974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.770210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8da7e-93b0-47c4-9287-54450e8f675c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:00.775448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:00.776102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.776473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.776744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] PATH_INFO: `/v3/projects/1b67e0ac5f4743ca8b0899f943cdadf4/users/3feba8dbc2c14fb9afb64501b1de5435/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.778805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b67e0ac5f4743ca8b0899f943cdadf4, user_id=3feba8dbc2c14fb9afb64501b1de5435, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:00.781467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:00.793424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1308/2609] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:00 2022] PUT /identity/v3/projects/1b67e0ac5f4743ca8b0899f943cdadf4/users/3feba8dbc2c14fb9afb64501b1de5435/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:00.804600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:00.804923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:00.805275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:00.838330 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] MFA Rules not processed for user `3feba8dbc2c14fb9afb64501b1de5435`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:00.839592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:00.862831 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:00.912143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1302/2610] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:00.923999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:00.925782 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:00.995990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69968-eb6e-41dd-beaf-b6165eb2e573 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:01.000246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54edcf-7f96-4a00-8d63-fba6be0af53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:01.000877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54edcf-7f96-4a00-8d63-fba6be0af53a service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:01.001193 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54edcf-7f96-4a00-8d63-fba6be0af53a service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:01.001457 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54edcf-7f96-4a00-8d63-fba6be0af53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:01.011141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54edcf-7f96-4a00-8d63-fba6be0af53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:01.012580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54edcf-7f96-4a00-8d63-fba6be0af53a service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:01.022485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1309/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:01.051497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:01.114996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a421ed-babc-4a67-9102-559745e93037 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:01.119725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:01.120362 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:01.120632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:01.120895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] PATH_INFO: `/v3/users/9f7079da7110401184dd33e377bb6f5d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:01.122107 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7079da7110401184dd33e377bb6f5d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:01.124038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:01.169973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7079da7110401184dd33e377bb6f5d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.183221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7079da7110401184dd33e377bb6f5d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.190031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7079da7110401184dd33e377bb6f5d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.190731 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7079da7110401184dd33e377bb6f5d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.191373 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7079da7110401184dd33e377bb6f5d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.205997 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1303/2612] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:01 2022] DELETE /identity/v3/users/9f7079da7110401184dd33e377bb6f5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:01.210786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989f40-1033-40e0-bc10-35099519b370 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:01.211265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989f40-1033-40e0-bc10-35099519b370 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:01.211422 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989f40-1033-40e0-bc10-35099519b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:01.230673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-73989f40-1033-40e0-bc10-35099519b370 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:01.231856 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-73989f40-1033-40e0-bc10-35099519b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:01.262351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:01.293502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1310/2613] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:01.303421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:01.304914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:01.346920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:01.364859 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556295b-65c6-41bc-8f56-e58471dc3d45 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:01.368706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:01.369344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:01.369619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:01.369872 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:01.378911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:01.380327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:01.389729 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1304/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:01.672011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73989f40-1033-40e0-bc10-35099519b370 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:01.673589 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-73989f40-1033-40e0-bc10-35099519b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:01.686330 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73989f40-1033-40e0-bc10-35099519b370 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:01.691056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:01.691805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:01.692145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:01.692466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] PATH_INFO: `/v3/projects/3e4e8cfac87b485ebebfdaeabbaa3627` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:01.693751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4e8cfac87b485ebebfdaeabbaa3627)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:01.696109 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:01.743024 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4e8cfac87b485ebebfdaeabbaa3627', 'request_id': 'req-5d33b146-8b9a-4bb8-add1-d124c930aa1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.749015 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4e8cfac87b485ebebfdaeabbaa3627', 'request_id': 'req-5d33b146-8b9a-4bb8-add1-d124c930aa1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.757461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4e8cfac87b485ebebfdaeabbaa3627', 'request_id': 'req-5d33b146-8b9a-4bb8-add1-d124c930aa1e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.767926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] The token cache is being invalidate because project 3e4e8cfac87b485ebebfdaeabbaa3627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:01.768210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.768851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.770393 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1311/2615] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:01 2022] DELETE /identity/v3/projects/3e4e8cfac87b485ebebfdaeabbaa3627 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:01.774672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:01.784264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc849-53db-488a-8783-64bff3de0998 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:01.839386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:01.840013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:01.840277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:01.840534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] PATH_INFO: `/v3/users/3feba8dbc2c14fb9afb64501b1de5435` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:01.841687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3feba8dbc2c14fb9afb64501b1de5435)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:01.843590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:01.901731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:01.903264 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:01.908302 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3feba8dbc2c14fb9afb64501b1de5435'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.921390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3feba8dbc2c14fb9afb64501b1de5435'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.928653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3feba8dbc2c14fb9afb64501b1de5435'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.929505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3feba8dbc2c14fb9afb64501b1de5435'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.930196 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3feba8dbc2c14fb9afb64501b1de5435'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:01.944407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1305/2616] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:01 2022] DELETE /identity/v3/users/3feba8dbc2c14fb9afb64501b1de5435 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:01.963343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33b146-8b9a-4bb8-add1-d124c930aa1e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.014306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.014912 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.015184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.015437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.017188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:02.049041 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:02.096645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.098177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a8a7c-e96b-4074-86cf-59b1eddbff5c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.108363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1312/2617] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:17:02.236191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.238136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:02.338884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab530-a1a8-4d0f-b751-50965f6fafa1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.344623 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.345340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.345602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.345903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] PATH_INFO: `/v3/projects/1b67e0ac5f4743ca8b0899f943cdadf4` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.347163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b67e0ac5f4743ca8b0899f943cdadf4)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.349179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.350917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:02.419458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b67e0ac5f4743ca8b0899f943cdadf4', 'request_id': 'req-5628127c-4e90-4156-9fac-2d4d034b59bb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:02.430471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b67e0ac5f4743ca8b0899f943cdadf4', 'request_id': 'req-5628127c-4e90-4156-9fac-2d4d034b59bb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:02.438082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b67e0ac5f4743ca8b0899f943cdadf4', 'request_id': 'req-5628127c-4e90-4156-9fac-2d4d034b59bb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:02.451186 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] The token cache is being invalidate because project 1b67e0ac5f4743ca8b0899f943cdadf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:02.451553 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:02.452962 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5628127c-4e90-4156-9fac-2d4d034b59bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:02.454815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1306/2618] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:02 2022] DELETE /identity/v3/projects/1b67e0ac5f4743ca8b0899f943cdadf4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:02.460449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.461012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.461012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.483625 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:02.486456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:02.569139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1313/2619] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:02.576715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.576928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.577170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.596781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:02.598004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:02.606011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1307/2620] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:02.610593 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.621005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c2c86-cd9f-4bff-bc1b-089edd48f1ab None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.625957 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.626578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.626847 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.627158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.627768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:02.628067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.629707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.645650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1314/2621] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:02.646258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.655561 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b0441-67ee-4e44-94cc-c9a1c6f490fb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.660542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.661198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.661483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.661781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.662520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.664470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.704615 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1308/2622] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:02 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:02.709085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.719197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584acce-7225-42ee-a906-14c46786c8c8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.775355 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.775963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.776241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.776526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.777188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.779167 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.802513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1315/2623] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:02 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:02.807999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.822270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be30d9-bfcd-4c7e-b2bc-d4a5574c2356 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.827917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.828526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.828860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.829207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.829934 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.831916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.842830 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1309/2624] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:02.847150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.859829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a895-5bba-444b-b4e5-412a43c8c35d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.865634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923ff32-c729-4480-aafa-74a85df8bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.866236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ff32-c729-4480-aafa-74a85df8bfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.866519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ff32-c729-4480-aafa-74a85df8bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.866781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ff32-c729-4480-aafa-74a85df8bfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.867442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923ff32-c729-4480-aafa-74a85df8bfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.869373 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923ff32-c729-4480-aafa-74a85df8bfe1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.881827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1316/2625] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:02.886182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:02.896269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f2c3d-408e-4107-8d78-eb76e495c08c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:02.902247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:02.902892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.903163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.903426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] PATH_INFO: `/v3/projects/bd4661c0865f48d2ab2869d8e6d9c900/users/0dd452a2fd744f4d8f8ce08b6963a056/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.919167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4661c0865f48d2ab2869d8e6d9c900, user_id=0dd452a2fd744f4d8f8ce08b6963a056, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:02.921907 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:02.936049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1310/2626] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:02 2022] PUT /identity/v3/projects/bd4661c0865f48d2ab2869d8e6d9c900/users/0dd452a2fd744f4d8f8ce08b6963a056/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:02.946683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:02.946970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:02.947239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:02.975432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] MFA Rules not processed for user `0dd452a2fd744f4d8f8ce08b6963a056`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:02.976643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:02.996198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:03.044761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1317/2627] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:03.049515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.126569 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5318c1-46c8-4125-b6fb-1ebb0511a5ae admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.131773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.132387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.132660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.132928 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.133594 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.135518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.164722 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1311/2628] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:03 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:03.169085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.180291 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cda79-06eb-4444-8443-67a8967836bf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.237136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.237733 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.238004 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.238263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.239228 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.241262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.263700 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1318/2629] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:03 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:03.268061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.278583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b805-61fa-4908-8b66-aba7f4094b8a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.284078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.284671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.284941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.285243 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.286052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.287641 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.293461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:03.429088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1312/2630] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:03.435275 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.446270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea9e3-dfdf-443d-bea2-523ef3b469a1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.451064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.451711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.451985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.452281 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] PATH_INFO: `/v3/projects/a40e3afcff7649a6b29729f5fc6c7ef0/users/766183ddb5914d29898a52a2a5be4c4c/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.468737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40e3afcff7649a6b29729f5fc6c7ef0, user_id=766183ddb5914d29898a52a2a5be4c4c, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.471460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.491265 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1319/2631] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:03 2022] PUT /identity/v3/projects/a40e3afcff7649a6b29729f5fc6c7ef0/users/766183ddb5914d29898a52a2a5be4c4c/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:03.495461 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.506231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5fa7-e3f8-4082-827b-b3271d4ada64 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.564082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df98b-c6f7-4556-9158-d9bb610ed499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.564662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df98b-c6f7-4556-9158-d9bb610ed499 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.564926 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df98b-c6f7-4556-9158-d9bb610ed499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.565219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df98b-c6f7-4556-9158-d9bb610ed499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.565841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df98b-c6f7-4556-9158-d9bb610ed499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.567406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df98b-c6f7-4556-9158-d9bb610ed499 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.577463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1313/2632] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:03.581630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.592125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0a84f-46c2-4461-8124-c3c6e60d680b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.598248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.598896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.599172 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.599438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] PATH_INFO: `/v3/projects/a40e3afcff7649a6b29729f5fc6c7ef0/users/766183ddb5914d29898a52a2a5be4c4c/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.601926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40e3afcff7649a6b29729f5fc6c7ef0, user_id=766183ddb5914d29898a52a2a5be4c4c, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.604339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.616205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1320/2633] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:03 2022] PUT /identity/v3/projects/a40e3afcff7649a6b29729f5fc6c7ef0/users/766183ddb5914d29898a52a2a5be4c4c/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:03.686326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.686544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.686751 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.715836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] MFA Rules not processed for user `766183ddb5914d29898a52a2a5be4c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:03.717125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:03.797975 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1314/2634] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:03.809399 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:03.811154 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:03.873048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef971b-23ab-4add-9cf3-395ced5e0c5a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:03.876599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:03.877244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:03.877517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:03.877781 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:03.887336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:03.889955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:03.901374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1321/2635] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:04.004518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:04.005783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:04.017601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10daa07-bd8d-4925-a40d-a1a9121fe2cf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:04.021221 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e231e8-b37b-4acc-a31d-7a34b21d2f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:04.021894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e231e8-b37b-4acc-a31d-7a34b21d2f1e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:04.022259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e231e8-b37b-4acc-a31d-7a34b21d2f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:04.022593 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e231e8-b37b-4acc-a31d-7a34b21d2f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:04.092043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e231e8-b37b-4acc-a31d-7a34b21d2f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:04.093675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e231e8-b37b-4acc-a31d-7a34b21d2f1e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:04.103191 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1315/2636] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:06.700967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:06.720009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:06.765197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a18d9c-118a-4e5f-8838-f184195218d7 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:06.769853 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:06.770499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:06.770769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:06.771055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] PATH_INFO: `/v3/users/0dd452a2fd744f4d8f8ce08b6963a056` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:06.772236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd452a2fd744f4d8f8ce08b6963a056)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:06.774429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:06.826712 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd452a2fd744f4d8f8ce08b6963a056'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:06.834032 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd452a2fd744f4d8f8ce08b6963a056'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:06.846821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd452a2fd744f4d8f8ce08b6963a056'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:06.847490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd452a2fd744f4d8f8ce08b6963a056'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:06.848087 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd452a2fd744f4d8f8ce08b6963a056'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:06.862760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1322/2637] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:06 2022] DELETE /identity/v3/users/0dd452a2fd744f4d8f8ce08b6963a056 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:06.868323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:06.868844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:06.868969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:06.889746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:06.891145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:06.904635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:06.954066 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1316/2638] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:06.964210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:06.965785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:07.024862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6219f5-76f4-4db4-9a85-684b4b99f55b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:07.028817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:07.029450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:07.029723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:07.029983 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:07.039560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:07.041009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:07.050392 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1323/2639] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:07.330558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:07.332312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:07.346788 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0f710-5513-4bf3-b611-ccba626ad163 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:07.351778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:07.352541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:07.352905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:07.353317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] PATH_INFO: `/v3/projects/bd4661c0865f48d2ab2869d8e6d9c900` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:07.354511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4661c0865f48d2ab2869d8e6d9c900)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:07.356669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:07.411377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4661c0865f48d2ab2869d8e6d9c900', 'request_id': 'req-838c3574-d0ee-4cb2-bbf8-ede877d2025b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.421345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4661c0865f48d2ab2869d8e6d9c900', 'request_id': 'req-838c3574-d0ee-4cb2-bbf8-ede877d2025b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.429037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4661c0865f48d2ab2869d8e6d9c900', 'request_id': 'req-838c3574-d0ee-4cb2-bbf8-ede877d2025b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.441038 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] The token cache is being invalidate because project bd4661c0865f48d2ab2869d8e6d9c900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:07.441536 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.442390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.444323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1317/2640] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:07 2022] DELETE /identity/v3/projects/bd4661c0865f48d2ab2869d8e6d9c900 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:07.448634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:07.458904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cb67-5a00-45ee-88b8-1685586a0bcd service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:07.494814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:07.523879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:07.524550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:07.524824 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:07.525136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] PATH_INFO: `/v3/users/766183ddb5914d29898a52a2a5be4c4c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:07.526266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766183ddb5914d29898a52a2a5be4c4c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:07.528194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:07.576560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766183ddb5914d29898a52a2a5be4c4c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.586329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766183ddb5914d29898a52a2a5be4c4c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.599879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766183ddb5914d29898a52a2a5be4c4c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.600573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766183ddb5914d29898a52a2a5be4c4c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.601253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1f83b32-ad59-46d9-829b-7f5bbec15d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766183ddb5914d29898a52a2a5be4c4c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:07.614723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1324/2641] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:07 2022] DELETE /identity/v3/users/766183ddb5914d29898a52a2a5be4c4c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:07.918363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:07.920676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:07.936794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c3574-d0ee-4cb2-bbf8-ede877d2025b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:07.993849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:07.994495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:07.994761 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:07.995022 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] PATH_INFO: `/v3/projects/a40e3afcff7649a6b29729f5fc6c7ef0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:07.996122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40e3afcff7649a6b29729f5fc6c7ef0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:07.998145 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.049069 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:08.052699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40e3afcff7649a6b29729f5fc6c7ef0', 'request_id': 'req-f2832825-c674-42bc-be88-da1290bbadd2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:08.061079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40e3afcff7649a6b29729f5fc6c7ef0', 'request_id': 'req-f2832825-c674-42bc-be88-da1290bbadd2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:08.068058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40e3afcff7649a6b29729f5fc6c7ef0', 'request_id': 'req-f2832825-c674-42bc-be88-da1290bbadd2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:08.079978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] The token cache is being invalidate because project a40e3afcff7649a6b29729f5fc6c7ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:08.080287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:08.081033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f2832825-c674-42bc-be88-da1290bbadd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:08.082838 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1318/2642] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:07 2022] DELETE /identity/v3/projects/a40e3afcff7649a6b29729f5fc6c7ef0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:08.087778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.088249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.088347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.109581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:08.111022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:08.182611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1325/2643] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:08.190700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.191048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.191341 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.211332 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:08.212531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:08.221230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1319/2644] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:08.225752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.235698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46516c5-7897-434d-8d08-1d96ea99e1a9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.240836 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.241499 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.241797 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.242136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.242775 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:08.243092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.244667 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.256331 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1326/2645] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:08.260672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.269976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e36b-f94c-41e8-a66c-cb0e7c0e66a5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.275193 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.275746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.276020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.276287 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.276899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.278836 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.307521 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1320/2646] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:08 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:08.311981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.322694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436d87-d12d-440d-9cd0-94a18f7a1079 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.366618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:08.383481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.384084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.384365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.384634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.385298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.387217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.410819 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1327/2647] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:08 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:08.415163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.426001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c911094-d5ef-4697-a7c3-1e0e51b3876a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.431715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.432309 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.432580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.432841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.433542 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.435283 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.445671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1321/2648] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:08.449675 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.460223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56d8b0-74e9-450b-8019-7578aa671d0f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.465479 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b4e5-d314-46d5-b58a-69fd99487c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.466069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b4e5-d314-46d5-b58a-69fd99487c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.466367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b4e5-d314-46d5-b58a-69fd99487c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.466612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b4e5-d314-46d5-b58a-69fd99487c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.467249 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b4e5-d314-46d5-b58a-69fd99487c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.468860 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b4e5-d314-46d5-b58a-69fd99487c5c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.479514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1328/2649] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:08.483812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.494492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b018e-1d40-481a-9772-b900993563d0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.499738 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.500400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.500671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.500932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] PATH_INFO: `/v3/projects/ac0cc13c40054a648d945878b4e80794/users/aea00aab7fd2423992066b08cf47d6d3/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.517226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0cc13c40054a648d945878b4e80794, user_id=aea00aab7fd2423992066b08cf47d6d3, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.519976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.535839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1322/2650] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:08 2022] PUT /identity/v3/projects/ac0cc13c40054a648d945878b4e80794/users/aea00aab7fd2423992066b08cf47d6d3/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:08.550525 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.550986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.551368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.585116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] MFA Rules not processed for user `aea00aab7fd2423992066b08cf47d6d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:08.586322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:08.655855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1329/2651] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:08.667829 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:08.669941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:08.733954 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e091109-56df-48ce-845f-ad311244c915 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:08.737612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:08.738214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:08.738848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:08.739117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:08.748376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:08.749972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:08.759364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1323/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:09.041287 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:09.042729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:09.105952 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cbdfe-fd43-4a7e-b60a-42da400bb204 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:09.110062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:09.110772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:09.111099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:09.111366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:09.113176 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:09.184672 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:09.186490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:09.197074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1330/2653] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:12.389820 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:12.392433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:12.484220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:12.493239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:12.505284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:12.519217 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93fb29-a24d-48df-81d5-7aa64fe1f219 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:12.522042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bf89-828e-40df-94b5-96ad165f9ccf service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:12.527433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:12.528080 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:12.528356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:12.528467 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:12.528622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] PATH_INFO: `/v3/users/d01d3fdea0f9451e8301003c34734569` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:12.529151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:12.529453 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:12.529776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:12.530135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01d3fdea0f9451e8301003c34734569)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:12.531649 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:12.532216 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:12.546334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:12.547695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:12.558449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1324/2654] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:17:12.586810 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01d3fdea0f9451e8301003c34734569'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:12.598007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01d3fdea0f9451e8301003c34734569'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:12.610466 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01d3fdea0f9451e8301003c34734569'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:12.611125 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01d3fdea0f9451e8301003c34734569'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:12.611715 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-44f12bbe-3ae9-4873-ba4c-1f120ff94250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01d3fdea0f9451e8301003c34734569'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:12.624654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1331/2655] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:12 2022] DELETE /identity/v3/users/d01d3fdea0f9451e8301003c34734569 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:12.829599 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:12.835308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:12.845437 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8dd0d-6484-4cf0-beba-11d76492fb99 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:12.931939 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:12.932584 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:12.932863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:12.936218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] PATH_INFO: `/v3/projects/124fbb2ac706401bb9511568ea4dbe67` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:12.936927 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124fbb2ac706401bb9511568ea4dbe67)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:12.939442 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:12.989086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124fbb2ac706401bb9511568ea4dbe67', 'request_id': 'req-2d3aa70a-e407-4ea7-ad93-615726de2ec8'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:12.997865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124fbb2ac706401bb9511568ea4dbe67', 'request_id': 'req-2d3aa70a-e407-4ea7-ad93-615726de2ec8'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.004218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124fbb2ac706401bb9511568ea4dbe67', 'request_id': 'req-2d3aa70a-e407-4ea7-ad93-615726de2ec8'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.015620 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] The token cache is being invalidate because project 124fbb2ac706401bb9511568ea4dbe67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:13.016138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.016784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2d3aa70a-e407-4ea7-ad93-615726de2ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.018487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1325/2656] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:12 2022] DELETE /identity/v3/projects/124fbb2ac706401bb9511568ea4dbe67 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:13.023669 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.023946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.024254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.045055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:13.046296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:13.107827 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1332/2657] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:13.116387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.116666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.116929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.138488 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:13.139709 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:13.148568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1326/2658] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:13.153315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.164214 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27b9ca-f2b1-4790-b395-7d8d693562bf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.169369 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.169964 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.170236 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.170498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.171138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:13.171433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.173086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.186163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1333/2659] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:13.191087 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.200955 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c50c3-6932-47c7-bddd-73a1e7123cd4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.205643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.206237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.206890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.206890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.207397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.209301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.240110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1327/2660] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:13.244575 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.254623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f885a-4487-42ad-a8bf-9e5a379393c6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.311343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.311943 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.312217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.312482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.313166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.315043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.323995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:13.341325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1334/2661] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:13.342578 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.353452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27639-2bfb-4486-be7a-6f2cac5aff6e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.358476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.359096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.359389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.359674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.360311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.361996 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.372575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1328/2662] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:13.376731 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.387989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64281fd-eebd-4ea3-8b52-d6d57f8c0e6f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.393196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb03d9a-e042-423a-8f47-c5e0dace9e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.393799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03d9a-e042-423a-8f47-c5e0dace9e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.394074 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03d9a-e042-423a-8f47-c5e0dace9e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.394333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03d9a-e042-423a-8f47-c5e0dace9e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.394985 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03d9a-e042-423a-8f47-c5e0dace9e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.396592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03d9a-e042-423a-8f47-c5e0dace9e7f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.408654 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1335/2663] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:13.413195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.423449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65436-dcdf-40a6-b2cd-e416a7889680 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.428359 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.429011 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.429304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.429571 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] PATH_INFO: `/v3/projects/4fc516a8c33143a296c695e17c88172d/users/248a8e8cf7f74e61b903cd16d93dfa3b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.444434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc516a8c33143a296c695e17c88172d, user_id=248a8e8cf7f74e61b903cd16d93dfa3b, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.447127 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.461668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1329/2664] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:13 2022] PUT /identity/v3/projects/4fc516a8c33143a296c695e17c88172d/users/248a8e8cf7f74e61b903cd16d93dfa3b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:13.473069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.473350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.473615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.503028 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] MFA Rules not processed for user `248a8e8cf7f74e61b903cd16d93dfa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:13.504433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:13.576616 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1336/2665] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:13.583747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.617869 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:13.657223 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428126e-da6a-4287-9108-aba0759e3e05 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.662474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.663278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.663688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.663969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.664597 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.666849 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.696226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1330/2666] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:13.700500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.711294 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e4ec-df0e-4860-b972-b6647674a8e6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.768005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.768599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.768874 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.769171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.769808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.771792 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.795126 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1337/2667] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:13.799408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.809842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5bbc4-b493-4b20-851d-037ad1cb0761 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.815450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.816041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.816310 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.816635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.817320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.819304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.829556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1331/2668] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:13.833808 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.844608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54af9-39bc-4c11-a27e-a49b42e6b772 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.850115 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.850834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.851165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.851334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] PATH_INFO: `/v3/projects/bf0cc4c391db4492904733a7f2f33c88/users/82b2592ec14a40139f4592d63fa3d902/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.860860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.863230 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:13.869574 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0cc4c391db4492904733a7f2f33c88, user_id=82b2592ec14a40139f4592d63fa3d902, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.872244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.876998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfbcc3-d66e-45ba-b2cc-de8b020e3cb3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.882350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.883032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.883296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.883558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] PATH_INFO: `/v3/users/aea00aab7fd2423992066b08cf47d6d3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.884777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea00aab7fd2423992066b08cf47d6d3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.886031 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1338/2669] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:13 2022] PUT /identity/v3/projects/bf0cc4c391db4492904733a7f2f33c88/users/82b2592ec14a40139f4592d63fa3d902/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:13.886781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.889915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.930315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:13.937485 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea00aab7fd2423992066b08cf47d6d3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.949627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea00aab7fd2423992066b08cf47d6d3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.954070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b8d0f-4703-4490-bb03-f03d48c01fe1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.957454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea00aab7fd2423992066b08cf47d6d3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.958122 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea00aab7fd2423992066b08cf47d6d3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.958725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e77ffd44-ad6f-49f6-85b0-806a838df90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea00aab7fd2423992066b08cf47d6d3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:13.959211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:13.959882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.960230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.960566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.961440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:13.963196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:13.973180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1332/2670] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:13 2022] DELETE /identity/v3/users/aea00aab7fd2423992066b08cf47d6d3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:13.974342 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1339/2671] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:13.977403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:13.977678 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:13.977937 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:13.980006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:13.982832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:13.997325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75eec9-2ba1-4c31-80f8-fff484a0c6c9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:13.999094 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:14.000319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:14.061431 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7977d-5877-4294-a1e2-81d6abfec7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:14.062363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7977d-5877-4294-a1e2-81d6abfec7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:14.062751 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7977d-5877-4294-a1e2-81d6abfec7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:14.062932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7977d-5877-4294-a1e2-81d6abfec7af admin admin] PATH_INFO: `/v3/projects/bf0cc4c391db4492904733a7f2f33c88/users/82b2592ec14a40139f4592d63fa3d902/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:14.064842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7977d-5877-4294-a1e2-81d6abfec7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0cc4c391db4492904733a7f2f33c88, user_id=82b2592ec14a40139f4592d63fa3d902, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:14.067317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1333/2672] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:14.067710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7977d-5877-4294-a1e2-81d6abfec7af admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:14.082476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:14.085441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:14.086748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1340/2673] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:13 2022] PUT /identity/v3/projects/bf0cc4c391db4492904733a7f2f33c88/users/82b2592ec14a40139f4592d63fa3d902/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:14.097657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:14.098042 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:14.098190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:14.116766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:14.129902 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] MFA Rules not processed for user `82b2592ec14a40139f4592d63fa3d902`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:14.131496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:14.164839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa96b7-2263-4e23-8066-f9600e560419 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:14.201598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1341/2674] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:14.212884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:14.214399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:14.214553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:14.215009 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:14.215278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:14.215544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:14.277235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85263d71-5e68-4b6a-840e-ee9eee6de000 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:14.279174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:14.280790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:14.281321 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:14.281986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:14.282267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:14.282533 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:14.290467 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:14.290723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1334/2675] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:14.295043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:14.297353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:14.308295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1342/2676] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:17:14.391619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:14.401219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a52c-8a38-4f8a-ae9a-ed9351dfbda3 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:14.404774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:14.405405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:14.405677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:14.406010 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:14.407662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:14.468854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:14.470262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:14.479378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1335/2677] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:14.564927 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:14.566498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:14.581462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f214f2b-4077-4b55-85d1-33d983a97d39 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:14.586835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:14.587456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:14.588256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:14.588256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] PATH_INFO: `/v3/projects/ac0cc13c40054a648d945878b4e80794` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:14.590382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0cc13c40054a648d945878b4e80794)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:14.592319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:14.653876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0cc13c40054a648d945878b4e80794', 'request_id': 'req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:14.660607 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0cc13c40054a648d945878b4e80794', 'request_id': 'req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:14.668626 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0cc13c40054a648d945878b4e80794', 'request_id': 'req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:14.679880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] The token cache is being invalidate because project ac0cc13c40054a648d945878b4e80794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:14.680166 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:14.680799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d07e09a1-2155-45bd-ae24-c0cb12ddef4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:14.682360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1343/2678] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:14 2022] DELETE /identity/v3/projects/ac0cc13c40054a648d945878b4e80794 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:15.148933 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:15.150534 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:15.165126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354399-3e2b-4adb-9f3b-b0448b6bac7e service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:15.183117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:15.226505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:15.227142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:15.227421 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:15.227720 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] PATH_INFO: `/v3/users/e98d048f8c0a4f6d9896a3cea795b282` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:15.228891 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98d048f8c0a4f6d9896a3cea795b282)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:15.230861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:15.281142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98d048f8c0a4f6d9896a3cea795b282'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.293057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98d048f8c0a4f6d9896a3cea795b282'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.300746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98d048f8c0a4f6d9896a3cea795b282'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.301842 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98d048f8c0a4f6d9896a3cea795b282'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.302780 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98d048f8c0a4f6d9896a3cea795b282'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.318625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1336/2679] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:15 2022] DELETE /identity/v3/users/e98d048f8c0a4f6d9896a3cea795b282 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:15.323736 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:15.324014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:15.324278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:15.343897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:15.345188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:15.405835 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1344/2680] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:15.415876 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:15.417601 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:15.485776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318834-8805-4239-916f-5de81415cd4b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:15.490228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:15.490834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:15.491110 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:15.491378 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:15.501518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:15.502971 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:15.512746 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1337/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:15.795974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:15.797956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:15.814311 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689719-268e-4160-a4e8-bb080696a8f4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:15.821684 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:15.822491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:15.822882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:15.823221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] PATH_INFO: `/v3/projects/f15c7cf102f34795a2db9a8d75c74455` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:15.824596 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15c7cf102f34795a2db9a8d75c74455)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:15.827598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:15.880338 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15c7cf102f34795a2db9a8d75c74455', 'request_id': 'req-788de188-8122-4387-b2b1-8d02e05a65fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.887084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15c7cf102f34795a2db9a8d75c74455', 'request_id': 'req-788de188-8122-4387-b2b1-8d02e05a65fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.895520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15c7cf102f34795a2db9a8d75c74455', 'request_id': 'req-788de188-8122-4387-b2b1-8d02e05a65fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.902855 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:15.906757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] The token cache is being invalidate because project f15c7cf102f34795a2db9a8d75c74455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:15.907207 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.908247 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:15.910147 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1345/2682] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:15 2022] DELETE /identity/v3/projects/f15c7cf102f34795a2db9a8d75c74455 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:15.913988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:15.924024 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6405-c8f5-485b-af0b-b62a70f1cc7d service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:15.963852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:15.984824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:15.985439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:15.985711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:15.985974 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] PATH_INFO: `/v3/users/5b409ebc7ab34b21bbf813627cc8ce5f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:15.987251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b409ebc7ab34b21bbf813627cc8ce5f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:15.989528 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.039966 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b409ebc7ab34b21bbf813627cc8ce5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.052804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b409ebc7ab34b21bbf813627cc8ce5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.060016 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b409ebc7ab34b21bbf813627cc8ce5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.060737 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b409ebc7ab34b21bbf813627cc8ce5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.061357 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-17056067-d490-4db9-81db-97339e88c6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b409ebc7ab34b21bbf813627cc8ce5f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.091260 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1338/2683] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:15 2022] DELETE /identity/v3/users/5b409ebc7ab34b21bbf813627cc8ce5f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:16.374753 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.376224 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:16.397316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788de188-8122-4387-b2b1-8d02e05a65fa admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.456639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.457225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.457503 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.457773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] PATH_INFO: `/v3/projects/c189794721ab4462a3585528bc8f9ffa` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.458913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c189794721ab4462a3585528bc8f9ffa)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.460939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.513169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c189794721ab4462a3585528bc8f9ffa', 'request_id': 'req-40b71030-9511-4782-b81d-b3262fc3f650'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.519485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c189794721ab4462a3585528bc8f9ffa', 'request_id': 'req-40b71030-9511-4782-b81d-b3262fc3f650'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.528310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c189794721ab4462a3585528bc8f9ffa', 'request_id': 'req-40b71030-9511-4782-b81d-b3262fc3f650'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.539104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] The token cache is being invalidate because project c189794721ab4462a3585528bc8f9ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:16.539385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.540059 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b71030-9511-4782-b81d-b3262fc3f650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:16.541622 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1346/2684] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:16 2022] DELETE /identity/v3/projects/c189794721ab4462a3585528bc8f9ffa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:16.546884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.547352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.547470 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.567957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:16.569198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:16.630407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1339/2685] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:16.638701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.638979 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.639243 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.660534 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:16.661791 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:16.670690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1347/2686] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:16.675141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.685575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b618c-fcfc-4fd8-bef4-40b89ef2a0a0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.691114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.691710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.691981 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.692241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.692882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:16.693222 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.694817 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.707046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1340/2687] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:16.711509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.721197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ff00-b47a-411a-9140-570ef2647928 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.726842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.727434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.727709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.727967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.728594 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.730560 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.761648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1348/2688] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:16 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:16.765734 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.775682 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd713598-bc34-4284-bf2a-2dad466a19f1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.819843 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:16.833121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.833727 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.834005 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.834275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.834892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.836792 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.860377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1341/2689] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:16 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:16.865040 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.875990 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8443-56ca-43f4-94a6-184e9f6237ec admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.881421 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.882014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.882290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.882554 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.883365 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.885012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.895691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1349/2690] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:16.899781 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.910174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e98925-0fdc-47c7-8076-158b8b0daec5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.916154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f19ce-8aeb-41cd-b121-bd0f55dcc109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.916745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f19ce-8aeb-41cd-b121-bd0f55dcc109 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.917012 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f19ce-8aeb-41cd-b121-bd0f55dcc109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.917323 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f19ce-8aeb-41cd-b121-bd0f55dcc109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.917969 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f19ce-8aeb-41cd-b121-bd0f55dcc109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.919549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f19ce-8aeb-41cd-b121-bd0f55dcc109 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.930602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1342/2691] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:16.935153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:16.945483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372b6c4-82e4-4238-ab89-8c86559775e9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:16.950345 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:16.950963 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.951235 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.951489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] PATH_INFO: `/v3/projects/550d7ba677ca4c669d7072d37f725dd1/users/de353e5475c9495ebf29067828eb5775/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:16.966130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=550d7ba677ca4c669d7072d37f725dd1, user_id=de353e5475c9495ebf29067828eb5775, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:16.968673 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:16.983030 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1350/2692] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:16 2022] PUT /identity/v3/projects/550d7ba677ca4c669d7072d37f725dd1/users/de353e5475c9495ebf29067828eb5775/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:16.994837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:16.995119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:16.995387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.022208 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] MFA Rules not processed for user `de353e5475c9495ebf29067828eb5775`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:17.023400 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:17.087988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1343/2693] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:17.094292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.128598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:17.164108 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c90e1-fada-4568-9b10-185f398766dc admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.169451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.170026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.170335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.170602 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.171223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.173217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.210788 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1351/2694] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:17 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:17.214093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.225530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eeb78-a965-4fce-8a22-3e268009520f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.284790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.285428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.285699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.285959 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.286568 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.290516 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.315683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1344/2695] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:17 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:17.315821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.327145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a16da-a8ac-4a8e-acc1-5a33f44d7b27 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.332752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.333443 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.333706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.334090 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.334613 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.336322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.347433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1352/2696] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:17.351762 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.362351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51f81-20fb-4d54-96ac-db0f6eeb6c54 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.367896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.368583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.368839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.369142 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] PATH_INFO: `/v3/projects/95b0e593dd084089b4954962e5d43641/users/0dbcb0d9b072417d8e1dafe920361989/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.385403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b0e593dd084089b4954962e5d43641, user_id=0dbcb0d9b072417d8e1dafe920361989, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.388180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.402515 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1345/2697] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:17 2022] PUT /identity/v3/projects/95b0e593dd084089b4954962e5d43641/users/0dbcb0d9b072417d8e1dafe920361989/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:17.407052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.423130 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914019-6545-4840-839d-8bb420544a9a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.480227 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c89392-b99c-4c4d-90e3-a0e2646d9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.480729 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89392-b99c-4c4d-90e3-a0e2646d9d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.481008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89392-b99c-4c4d-90e3-a0e2646d9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.481289 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89392-b99c-4c4d-90e3-a0e2646d9d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.481919 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89392-b99c-4c4d-90e3-a0e2646d9d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.483552 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89392-b99c-4c4d-90e3-a0e2646d9d7c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.494843 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1353/2698] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:17.499313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.509984 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec36953-3a7d-45c8-aba2-a8dcb46cb41f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.514459 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.515098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.515367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.515626 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] PATH_INFO: `/v3/projects/95b0e593dd084089b4954962e5d43641/users/0dbcb0d9b072417d8e1dafe920361989/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.517557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b0e593dd084089b4954962e5d43641, user_id=0dbcb0d9b072417d8e1dafe920361989, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.520160 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.531040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1346/2699] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:17 2022] PUT /identity/v3/projects/95b0e593dd084089b4954962e5d43641/users/0dbcb0d9b072417d8e1dafe920361989/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:17.541795 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.542082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.542351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.570385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] MFA Rules not processed for user `0dbcb0d9b072417d8e1dafe920361989`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:17.571833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:17.645353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1354/2700] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:17.656944 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:17.658879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:17.670765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:17.719718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf8fc-61c2-4054-998c-f2f5f159199f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:17.723575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842ad40-132f-4c33-a045-5b285fca7dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:17.724169 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842ad40-132f-4c33-a045-5b285fca7dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.724439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842ad40-132f-4c33-a045-5b285fca7dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.724699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842ad40-132f-4c33-a045-5b285fca7dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.780219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842ad40-132f-4c33-a045-5b285fca7dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:17.781689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842ad40-132f-4c33-a045-5b285fca7dd6 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:17.790624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1347/2701] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:18.604407 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:18.605907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:18.633925 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:18.673160 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d158-2f26-44ef-8dbf-44cc2b8fcaf2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:18.677690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:18.678317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:18.678588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:18.678851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] PATH_INFO: `/v3/users/248a8e8cf7f74e61b903cd16d93dfa3b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:18.679947 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=248a8e8cf7f74e61b903cd16d93dfa3b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:18.682011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:18.872217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248a8e8cf7f74e61b903cd16d93dfa3b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:18.880043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248a8e8cf7f74e61b903cd16d93dfa3b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:18.891904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248a8e8cf7f74e61b903cd16d93dfa3b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:18.892540 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248a8e8cf7f74e61b903cd16d93dfa3b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:18.893187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248a8e8cf7f74e61b903cd16d93dfa3b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:18.905483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1355/2702] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:18 2022] DELETE /identity/v3/users/248a8e8cf7f74e61b903cd16d93dfa3b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:18.910121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:18.910603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:18.910700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:18.931344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:18.932580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:18.994185 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1348/2703] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:19.004006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:19.005532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:19.064219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79ac22-1dd7-4a7f-9c8c-d5047cb2c3eb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:19.068325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:19.068903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:19.069212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:19.069462 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:19.079230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:19.080645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:19.090502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1356/2704] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:19.147068 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:19.148473 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:19.207114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17cf24-9103-4c55-873c-4812733ec83a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:19.210965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:19.211706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:19.211988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:19.212252 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:19.214268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:19.233404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:19.280909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:19.282404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:19.292167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1349/2705] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:19.374184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:19.375706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:19.396495 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0122ded-48c9-4c0d-8625-ae9ff2ee3a7a service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:19.401464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:19.402231 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:19.402515 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:19.402863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] PATH_INFO: `/v3/projects/4fc516a8c33143a296c695e17c88172d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:19.404803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc516a8c33143a296c695e17c88172d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:19.407506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:19.458826 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:19.468067 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc516a8c33143a296c695e17c88172d', 'request_id': 'req-5c14bcb3-8798-47f5-ad5b-83da694eb70b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.474514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc516a8c33143a296c695e17c88172d', 'request_id': 'req-5c14bcb3-8798-47f5-ad5b-83da694eb70b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.482798 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc516a8c33143a296c695e17c88172d', 'request_id': 'req-5c14bcb3-8798-47f5-ad5b-83da694eb70b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.493366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] The token cache is being invalidate because project 4fc516a8c33143a296c695e17c88172d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:19.493646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.494245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.495765 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1357/2706] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:19 2022] DELETE /identity/v3/projects/4fc516a8c33143a296c695e17c88172d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:19.500195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:19.511683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f52dd-4159-46a4-8e6d-5d96070305de service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:19.570922 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:19.571544 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:19.571815 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:19.572079 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] PATH_INFO: `/v3/users/82b2592ec14a40139f4592d63fa3d902` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:19.573317 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b2592ec14a40139f4592d63fa3d902)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:19.575251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:19.625078 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b2592ec14a40139f4592d63fa3d902'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.637721 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b2592ec14a40139f4592d63fa3d902'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.644903 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b2592ec14a40139f4592d63fa3d902'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.645630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b2592ec14a40139f4592d63fa3d902'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.646245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f0fbc4b-82ef-4181-9661-0e2bcad86987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b2592ec14a40139f4592d63fa3d902'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:19.660108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1350/2707] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:19 2022] DELETE /identity/v3/users/82b2592ec14a40139f4592d63fa3d902 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:19.942582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:19.944469 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:19.957579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14bcb3-8798-47f5-ad5b-83da694eb70b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.015658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.016203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.016472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.016734 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] PATH_INFO: `/v3/projects/bf0cc4c391db4492904733a7f2f33c88` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.018009 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0cc4c391db4492904733a7f2f33c88)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.019896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.066809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0cc4c391db4492904733a7f2f33c88', 'request_id': 'req-d7237048-60a4-436d-9353-8914841217b8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:20.072882 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0cc4c391db4492904733a7f2f33c88', 'request_id': 'req-d7237048-60a4-436d-9353-8914841217b8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:20.081720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0cc4c391db4492904733a7f2f33c88', 'request_id': 'req-d7237048-60a4-436d-9353-8914841217b8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:20.092021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] The token cache is being invalidate because project bf0cc4c391db4492904733a7f2f33c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:20.092302 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:20.093016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d7237048-60a4-436d-9353-8914841217b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:20.094557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1358/2708] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:19 2022] DELETE /identity/v3/projects/bf0cc4c391db4492904733a7f2f33c88 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:20.099659 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.100159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.100270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.120812 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:20.122061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:20.153265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:20.185206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1351/2709] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:20.194598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.194878 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.195139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.215460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:20.216663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:20.225168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1359/2710] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:20.229514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.239863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0d428-7cd3-4c0b-a681-5f296d6e9180 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.244957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.245574 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.245844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.246108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.246745 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:20.247036 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.248656 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.260049 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1352/2711] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:20.264704 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.277360 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fbf40-7d47-465f-ba7f-dd59267de075 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.283385 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.284163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.284434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.284696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.285353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.287388 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.315465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1360/2712] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:20.320040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.330570 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213536a-60ca-430c-ad10-f964d0ebac75 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.389908 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.390505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.390775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.391032 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.391651 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.393617 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.415822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1353/2713] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:20.421487 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.432173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58404-302b-4a7b-95b7-ccc7bbd2fae5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.437351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.437946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.438229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.438477 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.439112 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.440703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.450761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1361/2714] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:20.454861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.464825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26015-0de4-4be1-a89c-9b4215edae13 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.469582 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7998f96-98fa-4806-8f49-f24ad5e7d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.470167 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998f96-98fa-4806-8f49-f24ad5e7d2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.470434 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998f96-98fa-4806-8f49-f24ad5e7d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.470702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998f96-98fa-4806-8f49-f24ad5e7d2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.471326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7998f96-98fa-4806-8f49-f24ad5e7d2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.472906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7998f96-98fa-4806-8f49-f24ad5e7d2b9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.483284 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1354/2715] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:20.487530 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.498110 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47b9bc-e9eb-4efa-aa25-fb4c1f069135 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.503145 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.503794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.504494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.504494 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] PATH_INFO: `/v3/projects/d4630c24cf114ff6baf4495db69ab8e2/users/e9be7eeaf11d4b50bf729b538e84a109/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.519905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4630c24cf114ff6baf4495db69ab8e2, user_id=e9be7eeaf11d4b50bf729b538e84a109, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.522609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.524930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:20.539198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1362/2716] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:20 2022] PUT /identity/v3/projects/d4630c24cf114ff6baf4495db69ab8e2/users/e9be7eeaf11d4b50bf729b538e84a109/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:20.549755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.550123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.550458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.582970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] MFA Rules not processed for user `e9be7eeaf11d4b50bf729b538e84a109`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:20.584237 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:20.649883 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1355/2717] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:20.654536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.721502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e552cca-f7cb-4040-b8aa-45b697d11cc4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.726772 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.727412 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.727687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.727954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.728694 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.731267 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.761962 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1363/2718] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:20.766386 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.785430 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204519f-13a5-49e9-974c-8c97a98b47bd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.815176 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:20.847484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.848100 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.848376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.848632 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.849294 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.851199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.871924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1356/2719] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:20.876150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.886774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b8b7e-4ad8-4171-8325-14aa5e8fcec8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.891272 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.891862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.892161 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.892485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.893156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.894745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.904713 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1364/2720] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:20.908736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.918920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfce01-9947-4dae-b5c8-1d33648c689c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:20.924113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:20.924754 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.925039 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.925426 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] PATH_INFO: `/v3/projects/1a0b98a5fe634201b5ec56e06580ba7f/users/02c592c3c22c42f480ed7feaf136d10d/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.941157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0b98a5fe634201b5ec56e06580ba7f, user_id=02c592c3c22c42f480ed7feaf136d10d, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:20.944047 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:20.957824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1357/2721] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:20 2022] PUT /identity/v3/projects/1a0b98a5fe634201b5ec56e06580ba7f/users/02c592c3c22c42f480ed7feaf136d10d/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:20.961814 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.972025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5875a-71a3-48e1-92a5-6a44853775b9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:21.032949 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0dcc9-05a4-4805-8830-4f580ca2defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:21.033557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dcc9-05a4-4805-8830-4f580ca2defe admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.033832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dcc9-05a4-4805-8830-4f580ca2defe admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.034094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dcc9-05a4-4805-8830-4f580ca2defe admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.034723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0dcc9-05a4-4805-8830-4f580ca2defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:21.036309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0dcc9-05a4-4805-8830-4f580ca2defe admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:21.046353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1365/2722] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:21.050723 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:21.061352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c0e60-e574-47a5-abfd-c5064f0e296b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:21.066263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:21.066904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.067227 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.067533 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] PATH_INFO: `/v3/projects/1a0b98a5fe634201b5ec56e06580ba7f/users/02c592c3c22c42f480ed7feaf136d10d/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.069853 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0b98a5fe634201b5ec56e06580ba7f, user_id=02c592c3c22c42f480ed7feaf136d10d, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:21.072909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:21.084093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1358/2723] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:21 2022] PUT /identity/v3/projects/1a0b98a5fe634201b5ec56e06580ba7f/users/02c592c3c22c42f480ed7feaf136d10d/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:21.094686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.094967 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.095269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.125223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] MFA Rules not processed for user `02c592c3c22c42f480ed7feaf136d10d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:21.126473 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:21.179657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:21.199209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1366/2724] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:21.211469 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:21.213456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:21.273456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c129a8-73f8-4fc5-964b-15a3200727c5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:21.277218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:21.277807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.278074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.278331 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.291369 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:21.292848 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:21.302892 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1359/2725] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:21.384661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:21.395029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd42ed9-803c-4a00-b0c7-59c93142d2dc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:21.399262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37ca3-2cac-4b25-8a67-9adc5a85042c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:21.399861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37ca3-2cac-4b25-8a67-9adc5a85042c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.400136 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37ca3-2cac-4b25-8a67-9adc5a85042c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.400402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37ca3-2cac-4b25-8a67-9adc5a85042c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.458044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37ca3-2cac-4b25-8a67-9adc5a85042c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:21.459511 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37ca3-2cac-4b25-8a67-9adc5a85042c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:21.471322 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1367/2726] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:21.740061 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:21.808648 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f59ea4-bd33-4e66-82a1-496c0571dfbd service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:21.813613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:21.814238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.814513 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.814776 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] PATH_INFO: `/v3/users/e9be7eeaf11d4b50bf729b538e84a109` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.816055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9be7eeaf11d4b50bf729b538e84a109)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:21.818008 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:21.849168 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:21.870870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9be7eeaf11d4b50bf729b538e84a109'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:21.883282 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9be7eeaf11d4b50bf729b538e84a109'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:21.890211 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9be7eeaf11d4b50bf729b538e84a109'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:21.890890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9be7eeaf11d4b50bf729b538e84a109'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:21.891475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9be7eeaf11d4b50bf729b538e84a109'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:21.906458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1360/2727] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:21 2022] DELETE /identity/v3/users/e9be7eeaf11d4b50bf729b538e84a109 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:21.910974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.911293 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.911553 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.930845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:21.932188 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:21.991618 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1368/2728] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:22.005505 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:22.007102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:22.066919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f93f1-d26a-4400-b88c-cecb2e918936 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:22.070463 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:22.071058 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:22.071326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:22.071604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:22.080591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:22.082137 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:22.091795 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1361/2729] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:22.368706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:22.370375 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:22.382893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3e90-9f93-4f83-9682-39fe0de6df75 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:22.388326 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:22.388960 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:22.389374 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:22.389631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] PATH_INFO: `/v3/projects/d4630c24cf114ff6baf4495db69ab8e2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:22.390830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4630c24cf114ff6baf4495db69ab8e2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:22.392923 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:22.442904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4630c24cf114ff6baf4495db69ab8e2', 'request_id': 'req-dfd30acc-6294-45d3-a5b6-3899f6a236fe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.448930 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4630c24cf114ff6baf4495db69ab8e2', 'request_id': 'req-dfd30acc-6294-45d3-a5b6-3899f6a236fe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.459333 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4630c24cf114ff6baf4495db69ab8e2', 'request_id': 'req-dfd30acc-6294-45d3-a5b6-3899f6a236fe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.470174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] The token cache is being invalidate because project d4630c24cf114ff6baf4495db69ab8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:22.470450 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.471106 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.472623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1369/2730] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:22 2022] DELETE /identity/v3/projects/d4630c24cf114ff6baf4495db69ab8e2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:22.476742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:22.486894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724f0cf-25a9-46f4-96a2-e9836f62d86c service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:22.545554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:22.546175 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:22.546449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:22.546715 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] PATH_INFO: `/v3/users/02c592c3c22c42f480ed7feaf136d10d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:22.547833 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c592c3c22c42f480ed7feaf136d10d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:22.549793 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:22.597394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c592c3c22c42f480ed7feaf136d10d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.598514 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:22.611270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c592c3c22c42f480ed7feaf136d10d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.618914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c592c3c22c42f480ed7feaf136d10d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.619616 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c592c3c22c42f480ed7feaf136d10d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.620219 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6e802fb5-fc2b-4cc6-902c-6acc770bdbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c592c3c22c42f480ed7feaf136d10d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:22.635676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1362/2731] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:22 2022] DELETE /identity/v3/users/02c592c3c22c42f480ed7feaf136d10d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:22.913896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:22.915363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:22.928946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd30acc-6294-45d3-a5b6-3899f6a236fe admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:22.938014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:22.987219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:22.987913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:22.988537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:22.988799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] PATH_INFO: `/v3/projects/1a0b98a5fe634201b5ec56e06580ba7f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:22.989905 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0b98a5fe634201b5ec56e06580ba7f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:22.991831 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.038606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0b98a5fe634201b5ec56e06580ba7f', 'request_id': 'req-09b85e62-2ca3-4023-beca-49269c1b278a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.044789 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0b98a5fe634201b5ec56e06580ba7f', 'request_id': 'req-09b85e62-2ca3-4023-beca-49269c1b278a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.053777 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0b98a5fe634201b5ec56e06580ba7f', 'request_id': 'req-09b85e62-2ca3-4023-beca-49269c1b278a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.066298 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] The token cache is being invalidate because project 1a0b98a5fe634201b5ec56e06580ba7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:23.066656 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.067372 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.069056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1370/2732] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:22 2022] DELETE /identity/v3/projects/1a0b98a5fe634201b5ec56e06580ba7f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:23.074362 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada70db7-bb3e-4869-9e78-278b9be7575f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.074639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada70db7-bb3e-4869-9e78-278b9be7575f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.074905 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada70db7-bb3e-4869-9e78-278b9be7575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.100264 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ada70db7-bb3e-4869-9e78-278b9be7575f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:23.101511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ada70db7-bb3e-4869-9e78-278b9be7575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.109222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.110652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.166180 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1363/2733] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:23.174917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.175198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.175474 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.178433 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85e62-2ca3-4023-beca-49269c1b278a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.182982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.183604 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.183876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.184139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] PATH_INFO: `/v3/users/de353e5475c9495ebf29067828eb5775` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.185269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de353e5475c9495ebf29067828eb5775)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.187164 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.195096 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:23.196358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.204882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1364/2734] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:23.210272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.220017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c74cc-5355-4014-9677-3c86b65cfe58 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.224726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.225344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.225699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.226074 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.226487 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:23.226783 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.228398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.231666 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:23.234290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de353e5475c9495ebf29067828eb5775'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.242591 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1365/2735] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:17:23.243507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de353e5475c9495ebf29067828eb5775'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.246914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.256826 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785256f-6305-4b4f-ab65-879af0d82ff2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.257012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de353e5475c9495ebf29067828eb5775'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.257526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de353e5475c9495ebf29067828eb5775'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.258146 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-43006ff2-c69c-40e2-9f01-b5bb5eff1243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de353e5475c9495ebf29067828eb5775'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.262198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.262774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.263044 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.263311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.263918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.265852 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.270229 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1371/2736] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:23 2022] DELETE /identity/v3/users/de353e5475c9495ebf29067828eb5775 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:23.274521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.274796 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.275116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.294049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:23.295350 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.298414 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1366/2737] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:23.302530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.304171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.352924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1372/2738] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:23.362725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.364430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.366041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a9c1-b5aa-4d53-abf6-77980ea82609 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.370733 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.371345 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.371618 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.371884 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.372498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.374471 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.396446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1367/2739] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:23.400603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.410344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39704cca-3fb5-492a-8ee7-c9ffc9b0cfb7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.415529 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.416263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.416441 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.416850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.417531 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.419320 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.422344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63e867-8842-4d5f-82f0-128325bf434a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.433307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1368/2740] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:23.434628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.439693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:23.445375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368380-eed6-43b0-a998-c033cb0ac061 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.451355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.452021 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.452307 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.452906 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.453608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.455605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.466247 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1369/2741] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:23.470375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.472254 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc1b2-d079-4dfa-aca5-37af1063c00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.472859 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc1b2-d079-4dfa-aca5-37af1063c00c service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.473158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc1b2-d079-4dfa-aca5-37af1063c00c service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.473419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc1b2-d079-4dfa-aca5-37af1063c00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.480026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e817-6534-4c28-a78f-dccccf7f7b3e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.482437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbc1b2-d079-4dfa-aca5-37af1063c00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.483911 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbc1b2-d079-4dfa-aca5-37af1063c00c service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.485123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.485748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.486017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.486280 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] PATH_INFO: `/v3/projects/4eac84e40c114a838f1af3b9c48f37fe/users/50d6856efa794c03835ebaf27ed366c6/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.493749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1373/2742] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:23.502086 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eac84e40c114a838f1af3b9c48f37fe, user_id=50d6856efa794c03835ebaf27ed366c6, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.504782 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.519606 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1370/2743] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:23 2022] PUT /identity/v3/projects/4eac84e40c114a838f1af3b9c48f37fe/users/50d6856efa794c03835ebaf27ed366c6/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:23.529899 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115853-c270-4e16-ad2d-68163c55632d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.530196 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115853-c270-4e16-ad2d-68163c55632d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.530419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115853-c270-4e16-ad2d-68163c55632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.557948 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-58115853-c270-4e16-ad2d-68163c55632d None None] MFA Rules not processed for user `50d6856efa794c03835ebaf27ed366c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:23.559211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-58115853-c270-4e16-ad2d-68163c55632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.567737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:23.627803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1374/2744] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:23.640051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.641803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.702303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c612879-b127-423f-9879-7dfc9b6659ba admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.706224 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.706857 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.707124 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.707383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.715938 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.717387 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.726199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1371/2745] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:17:23.747935 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115853-c270-4e16-ad2d-68163c55632d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.772882 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.774454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.825303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115853-c270-4e16-ad2d-68163c55632d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.829841 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.830461 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.830735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.830999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] PATH_INFO: `/v3/users/50d6856efa794c03835ebaf27ed366c6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.832223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d6856efa794c03835ebaf27ed366c6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.834232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.842103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433dc7e-48b4-4e71-abff-d4c73440a5d5 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.847154 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.847773 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.848041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.848304 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] PATH_INFO: `/v3/projects/550d7ba677ca4c669d7072d37f725dd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.849438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550d7ba677ca4c669d7072d37f725dd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.851315 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.882951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d6856efa794c03835ebaf27ed366c6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.890703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d6856efa794c03835ebaf27ed366c6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.900447 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550d7ba677ca4c669d7072d37f725dd1', 'request_id': 'req-e89c0346-be57-4d55-9d82-ab43c528e0b3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.903488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d6856efa794c03835ebaf27ed366c6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.904150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d6856efa794c03835ebaf27ed366c6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.904801 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3c8bd314-a52f-4307-b923-a60aee4c7659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d6856efa794c03835ebaf27ed366c6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.908732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550d7ba677ca4c669d7072d37f725dd1', 'request_id': 'req-e89c0346-be57-4d55-9d82-ab43c528e0b3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.915141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550d7ba677ca4c669d7072d37f725dd1', 'request_id': 'req-e89c0346-be57-4d55-9d82-ab43c528e0b3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.917641 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1375/2746] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:23 2022] DELETE /identity/v3/users/50d6856efa794c03835ebaf27ed366c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:23.922232 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.922588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.922921 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.925674 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:23.929775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] The token cache is being invalidate because project 550d7ba677ca4c669d7072d37f725dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:23.930499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.932368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:23.937558 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1372/2747] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:23 2022] DELETE /identity/v3/projects/550d7ba677ca4c669d7072d37f725dd1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:23.938899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.941619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.943614 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:23.944774 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.968677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:24.005335 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1376/2748] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:24.009308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0346-be57-4d55-9d82-ab43c528e0b3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.012916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.013580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.013861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.014163 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] PATH_INFO: `/v3/users/0dbcb0d9b072417d8e1dafe920361989` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.015234 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.015355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbcb0d9b072417d8e1dafe920361989)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.016559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.017242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.068070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbcb0d9b072417d8e1dafe920361989'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.074829 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc229e4-bcf5-4b9a-97df-f42012913ecb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.079406 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.080158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.080436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.080701 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.085898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbcb0d9b072417d8e1dafe920361989'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.090588 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.092052 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.093043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbcb0d9b072417d8e1dafe920361989'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.093766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbcb0d9b072417d8e1dafe920361989'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.094416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbcb0d9b072417d8e1dafe920361989'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.101695 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1377/2749] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:17:24.108613 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1373/2750] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:23 2022] DELETE /identity/v3/users/0dbcb0d9b072417d8e1dafe920361989 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:24.378491 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.381849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.403846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.405353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d23c-af58-4ac0-94c3-98ca01d9aa23 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.405478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.468546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.469329 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.469661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.469981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] PATH_INFO: `/v3/projects/4eac84e40c114a838f1af3b9c48f37fe` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.471165 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eac84e40c114a838f1af3b9c48f37fe)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.473212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.475119 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ccbd3-1f2c-4fa7-ae61-f9056e163f90 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.479764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.480392 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.480972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.480972 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] PATH_INFO: `/v3/projects/95b0e593dd084089b4954962e5d43641` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.482043 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b0e593dd084089b4954962e5d43641)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.483961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.508141 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:24.520460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eac84e40c114a838f1af3b9c48f37fe', 'request_id': 'req-f3485438-392a-4427-8280-abd57ae32952'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.526714 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eac84e40c114a838f1af3b9c48f37fe', 'request_id': 'req-f3485438-392a-4427-8280-abd57ae32952'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.534078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eac84e40c114a838f1af3b9c48f37fe', 'request_id': 'req-f3485438-392a-4427-8280-abd57ae32952'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.536625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b0e593dd084089b4954962e5d43641', 'request_id': 'req-90d6d4a9-7152-4c4a-b688-6efd9620fb65'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.544333 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b0e593dd084089b4954962e5d43641', 'request_id': 'req-90d6d4a9-7152-4c4a-b688-6efd9620fb65'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.546248 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] The token cache is being invalidate because project 4eac84e40c114a838f1af3b9c48f37fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:24.546571 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.547269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f3485438-392a-4427-8280-abd57ae32952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.548862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1378/2751] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:24 2022] DELETE /identity/v3/projects/4eac84e40c114a838f1af3b9c48f37fe => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:24.552179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b0e593dd084089b4954962e5d43641', 'request_id': 'req-90d6d4a9-7152-4c4a-b688-6efd9620fb65'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.553605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23a88-5529-4e50-9c2f-c43833bf8d69 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.553883 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23a88-5529-4e50-9c2f-c43833bf8d69 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.554175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23a88-5529-4e50-9c2f-c43833bf8d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.561679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:24.563334 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] The token cache is being invalidate because project 95b0e593dd084089b4954962e5d43641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:24.563622 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.564343 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-90d6d4a9-7152-4c4a-b688-6efd9620fb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:24.566225 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1374/2752] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:24 2022] DELETE /identity/v3/projects/95b0e593dd084089b4954962e5d43641 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:24.570923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc0d2-a3d2-49fd-8764-ae7213b3dab0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.571668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc0d2-a3d2-49fd-8764-ae7213b3dab0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.572166 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc0d2-a3d2-49fd-8764-ae7213b3dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.577138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-03e23a88-5529-4e50-9c2f-c43833bf8d69 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:24.578356 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-03e23a88-5529-4e50-9c2f-c43833bf8d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.591394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-05ccc0d2-a3d2-49fd-8764-ae7213b3dab0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:24.592549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-05ccc0d2-a3d2-49fd-8764-ae7213b3dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.636484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1379/2753] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:24.644156 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.644437 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.644706 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.653090 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1375/2754] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:24.661698 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.661973 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.662234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.664068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:24.665301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.674887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1380/2755] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:24.679022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.684706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:24.685394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:24.687840 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb684e-378e-4548-8927-e0fa18b6fce7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.692453 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.693066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.693339 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.693581 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.693691 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1376/2756] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:24.694211 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:24.694509 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.696084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.698030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.707327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1e65f-e352-4fdd-a109-cb3eafaf74bf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.710851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1381/2757] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:17:24.711770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.712417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.713098 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.713372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.713637 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.714270 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:24.714563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.716140 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.721367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154d6a3-5948-4ee3-af37-910b42381b9a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.725918 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.726470 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.726740 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.727001 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.727606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.728452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1377/2758] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:17:24.729794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.732794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.742747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23418761-ba68-4606-8a2b-4f83c8fa85ab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.747486 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.748071 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.748367 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.748635 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.749276 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.751171 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.760429 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1382/2759] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:24.761332 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.778643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1378/2760] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:24.783013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.825650 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fbb34-6c92-4e45-b52c-8a90af0761a2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.843610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d4c1-d427-4b66-aa1b-158fe7caf392 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.849228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.849856 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.850130 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.850404 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.851018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.853031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.869730 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:24.878743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1379/2761] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:24.879946 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.887476 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.888086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.888361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.888652 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.889306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.889898 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dfe08-ebe4-43d9-a0c2-4ac41a84e12d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.891210 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.894588 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.895202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.895475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.895740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.896376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.898301 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.911576 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1380/2762] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:24.913739 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:24.916091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.921340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1383/2763] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:24 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:24.923770 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.926512 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985b331-a41e-4860-abe7-da06d6aa81ab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.931013 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.931664 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.931935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.932202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.932825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.933605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782ffc-f69d-4913-ab19-2eeedb6003e9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.934431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.938441 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.939026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.939299 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.939562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.940200 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.941815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.945236 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1381/2764] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:24.949300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.955177 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1384/2765] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:24.956221 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:24.960262 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1993259-66ed-4288-8c4d-35f37528316a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.965998 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889810-07db-452b-84b9-69c11444891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.966599 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3fedf-a171-44ac-bfe6-03ffa8c2e5c0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:24.966825 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889810-07db-452b-84b9-69c11444891a admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.966924 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889810-07db-452b-84b9-69c11444891a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.967117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889810-07db-452b-84b9-69c11444891a admin admin] PATH_INFO: `/v3/projects/184a76717d004a69bd18e2bb81b4b434/users/d8736bcc51a54e5a813127ab0c78b25a/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.971527 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:24.972149 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:24.972475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:24.972821 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:24.973542 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.975282 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.982630 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889810-07db-452b-84b9-69c11444891a admin admin] RBAC: Authorizing `identity:create_grant(project_id=184a76717d004a69bd18e2bb81b4b434, user_id=d8736bcc51a54e5a813127ab0c78b25a, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:24.985277 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889810-07db-452b-84b9-69c11444891a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:24.986344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1385/2766] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:24.991002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.000510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1382/2767] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:24 2022] PUT /identity/v3/projects/184a76717d004a69bd18e2bb81b4b434/users/d8736bcc51a54e5a813127ab0c78b25a/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:25.001293 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4c1a-2cae-4cfa-a430-693448df7579 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.010638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.010858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.011123 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.038935 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] MFA Rules not processed for user `d8736bcc51a54e5a813127ab0c78b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:25.039808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:25.057361 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5b3c1-6e1a-443b-a70f-94323a193c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.058007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5b3c1-6e1a-443b-a70f-94323a193c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.058278 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5b3c1-6e1a-443b-a70f-94323a193c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.058539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5b3c1-6e1a-443b-a70f-94323a193c69 admin admin] PATH_INFO: `/v3/projects/ea69ec63c5154fabbf0744e042ea91db/users/fe82b6bb86bc465dab0452fcc2aeab80/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.072483 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5b3c1-6e1a-443b-a70f-94323a193c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea69ec63c5154fabbf0744e042ea91db, user_id=fe82b6bb86bc465dab0452fcc2aeab80, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.075134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5b3c1-6e1a-443b-a70f-94323a193c69 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.089460 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1386/2768] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:24 2022] PUT /identity/v3/projects/ea69ec63c5154fabbf0744e042ea91db/users/fe82b6bb86bc465dab0452fcc2aeab80/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:25.100325 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.100605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.100924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.114886 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1383/2769] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:25.119390 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.131861 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e63a-19b6-462f-9ed7-1adb763bf389 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.134148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] MFA Rules not processed for user `fe82b6bb86bc465dab0452fcc2aeab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:25.135428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:25.188821 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.189460 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.189736 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.190037 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.190704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.192602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.196547 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1387/2770] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:25.207691 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.209135 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:25.222273 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1384/2771] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:25.226146 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.256200 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:25.263485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:25.267580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea1252-3468-4fd4-b46b-ab05729b27b4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.290391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4db96-3af1-4f75-a250-ebfaaa3135f4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.297041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.297666 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.297942 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.298213 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.298976 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.301189 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.321104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492a14e-f994-4c6e-bd95-36b57aaf4e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.321711 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492a14e-f994-4c6e-bd95-36b57aaf4e1c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.322038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492a14e-f994-4c6e-bd95-36b57aaf4e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.322300 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492a14e-f994-4c6e-bd95-36b57aaf4e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.325041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1385/2772] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:25.328968 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.338824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f2b4a-2cd1-4194-86f7-34eb51a46599 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.343342 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.343918 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.344188 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.344451 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.345121 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.346689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.356669 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1386/2773] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:25.360511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.370994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540263f-4d2d-4415-b6a2-b2212fe830f4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.375992 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.376577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.376850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.377150 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.377774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.379260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492a14e-f994-4c6e-bd95-36b57aaf4e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.379397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.380862 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492a14e-f994-4c6e-bd95-36b57aaf4e1c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.389716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1387/2774] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:25.390785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1388/2775] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:25.393888 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.404268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef2c5a-f037-4b0b-9d96-d03138d61d58 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.412834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.413530 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.413794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.414057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] PATH_INFO: `/v3/projects/00be4c37bdbd4243b09a70cacd3a2469/users/b8ca054817114f44b01f843be103d95b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.429311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=00be4c37bdbd4243b09a70cacd3a2469, user_id=b8ca054817114f44b01f843be103d95b, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.432004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.446423 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1388/2776] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:25 2022] PUT /identity/v3/projects/00be4c37bdbd4243b09a70cacd3a2469/users/b8ca054817114f44b01f843be103d95b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:25.456663 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.456941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.457270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.484806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] MFA Rules not processed for user `b8ca054817114f44b01f843be103d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:25.486025 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:25.555820 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1389/2777] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:25.560290 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.626518 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17b5b-db25-48f1-8496-a83503ce49ba admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.631215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.631810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.632088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.632349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.633014 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.638988 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.668311 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1389/2778] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:25.672449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.685039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cee1d-0dbf-436a-8785-700c8155f1fa None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.742376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:25.759996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.760606 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.760881 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.761173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.761799 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.763710 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.783852 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1390/2779] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:25.787991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.799031 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c4b2-1f34-478b-be29-281c81c45f96 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.804497 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.805117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.805427 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.805697 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.806335 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.807911 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.818699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1390/2780] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:25.823127 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.834044 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b240-4869-499c-ab78-b5bca260cf41 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.841537 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.842242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.842517 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.842783 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] PATH_INFO: `/v3/projects/8e19870bdedd4ff0b4b317438f5c6c34/users/c319d72f2b4542bb93a257cd46892cf8/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.862389 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e19870bdedd4ff0b4b317438f5c6c34, user_id=c319d72f2b4542bb93a257cd46892cf8, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.865522 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.882428 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1391/2781] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:25 2022] PUT /identity/v3/projects/8e19870bdedd4ff0b4b317438f5c6c34/users/c319d72f2b4542bb93a257cd46892cf8/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:25.886552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.897055 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5f000-60ee-4cc1-a02d-d66f4d9bbc5b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.944452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:25.961455 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd043c-0cc3-431a-8691-dababdb55266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.962109 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd043c-0cc3-431a-8691-dababdb55266 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.962383 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd043c-0cc3-431a-8691-dababdb55266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.962647 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd043c-0cc3-431a-8691-dababdb55266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.963274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd043c-0cc3-431a-8691-dababdb55266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:25.964970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd043c-0cc3-431a-8691-dababdb55266 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:25.975837 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1391/2782] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:25.980262 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:25.991794 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954deba-f647-45b8-bd91-120e63d8b406 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:25.997104 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:25.997756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.998029 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.998292 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] PATH_INFO: `/v3/projects/8e19870bdedd4ff0b4b317438f5c6c34/users/c319d72f2b4542bb93a257cd46892cf8/roles/b6a5fb3a069640758072d30fba5d307c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:26.000484 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e19870bdedd4ff0b4b317438f5c6c34, user_id=c319d72f2b4542bb93a257cd46892cf8, role_id=b6a5fb3a069640758072d30fba5d307c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:26.003168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:26.014069 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1392/2783] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:25 2022] PUT /identity/v3/projects/8e19870bdedd4ff0b4b317438f5c6c34/users/c319d72f2b4542bb93a257cd46892cf8/roles/b6a5fb3a069640758072d30fba5d307c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:26.025326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:26.025603 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:26.025864 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:26.054923 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] MFA Rules not processed for user `c319d72f2b4542bb93a257cd46892cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:26.056070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:26.126091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1392/2784] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:26.137367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:26.197924 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5f8db-7da9-4735-9104-babed259ea34 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:26.204681 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:26.205643 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:26.206027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:26.206366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:26.218651 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:26.220097 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:26.229815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1393/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:26.775511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:26.787693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398a15e-0514-4e6f-9e31-f058d18e830d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:26.792701 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc95f2-a775-4d22-b5ae-674a35a184a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:26.793511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc95f2-a775-4d22-b5ae-674a35a184a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:26.794417 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc95f2-a775-4d22-b5ae-674a35a184a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:26.794896 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc95f2-a775-4d22-b5ae-674a35a184a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:26.862482 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc95f2-a775-4d22-b5ae-674a35a184a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:26.864511 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc95f2-a775-4d22-b5ae-674a35a184a0 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:26.875449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1393/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:28.490384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:28.571910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe64e4c-f40a-4c8b-b201-50e9a8d28f4e service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:28.576566 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:28.577220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:28.577489 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:28.577758 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] PATH_INFO: `/v3/users/fe82b6bb86bc465dab0452fcc2aeab80` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:28.578904 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe82b6bb86bc465dab0452fcc2aeab80)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:28.580800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:28.654222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:28.660490 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe82b6bb86bc465dab0452fcc2aeab80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:28.670075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe82b6bb86bc465dab0452fcc2aeab80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:28.683314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe82b6bb86bc465dab0452fcc2aeab80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:28.684046 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe82b6bb86bc465dab0452fcc2aeab80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:28.684646 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe82b6bb86bc465dab0452fcc2aeab80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:28.696999 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1394/2787] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:28 2022] DELETE /identity/v3/users/fe82b6bb86bc465dab0452fcc2aeab80 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:28.701627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7732c-f880-478d-8492-701d5967731f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:28.702152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7732c-f880-478d-8492-701d5967731f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:28.702152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7732c-f880-478d-8492-701d5967731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:28.721890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4ad7732c-f880-478d-8492-701d5967731f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:28.723070 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4ad7732c-f880-478d-8492-701d5967731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:28.781704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1394/2788] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:28.791752 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:28.793324 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:28.851173 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f72a61-f65d-411e-ba55-9335fc5278b3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:28.855240 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ad9f-996b-4a7c-8a6a-5126393918ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:28.855842 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ad9f-996b-4a7c-8a6a-5126393918ab service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:28.856158 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ad9f-996b-4a7c-8a6a-5126393918ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:28.856395 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ad9f-996b-4a7c-8a6a-5126393918ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:28.866286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ad9f-996b-4a7c-8a6a-5126393918ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:28.867690 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ad9f-996b-4a7c-8a6a-5126393918ab service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:28.877315 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1395/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:17:29.159327 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7732c-f880-478d-8492-701d5967731f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.160916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4ad7732c-f880-478d-8492-701d5967731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:29.174422 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:29.179642 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7732c-f880-478d-8492-701d5967731f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.185303 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.185951 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.186215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.186476 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] PATH_INFO: `/v3/projects/ea69ec63c5154fabbf0744e042ea91db` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.187732 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea69ec63c5154fabbf0744e042ea91db)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.189577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.242667 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea69ec63c5154fabbf0744e042ea91db', 'request_id': 'req-83f4d6de-647b-4211-81ed-72fbefe436a6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:29.250556 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea69ec63c5154fabbf0744e042ea91db', 'request_id': 'req-83f4d6de-647b-4211-81ed-72fbefe436a6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:29.256860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea69ec63c5154fabbf0744e042ea91db', 'request_id': 'req-83f4d6de-647b-4211-81ed-72fbefe436a6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:29.267002 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] The token cache is being invalidate because project ea69ec63c5154fabbf0744e042ea91db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:29.267285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:29.267909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-83f4d6de-647b-4211-81ed-72fbefe436a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:29.269508 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1395/2790] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:29 2022] DELETE /identity/v3/projects/ea69ec63c5154fabbf0744e042ea91db => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:29.274455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.274876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.275242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.294761 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:29.296039 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:29.357186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1396/2791] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:29.369265 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.369557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.369824 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.389257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:29.390429 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:29.398552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1396/2792] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:29.403006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.413198 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da01b5-fa30-4c5b-a3c8-fcac05083c4a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.418725 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.419314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.419582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.419848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.420463 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:29.420762 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.422384 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.434988 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1397/2793] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:17:29.439424 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.449091 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779cf27-0c87-4556-a05c-c16dfd25a711 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.454743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.455351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.455672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.455957 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.456581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.458589 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.489275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1397/2794] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:29 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:29.493398 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.504358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcddfc-761b-46bf-8495-88e9eba349a1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.555894 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:29.567316 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.567917 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.568186 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.568447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.569085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.570986 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.593726 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1398/2795] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:29 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:29.598050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.608607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07275e9-7223-4d9c-8fcb-d7384aee8581 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.613624 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.614214 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.614479 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.614735 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.615394 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.616967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.627184 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1398/2796] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:29.631323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.641348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30206ac5-f073-4308-8247-4f008d501ce9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.646083 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c409c5-9d4f-4ac7-a0da-8947c15bdaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.646664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c409c5-9d4f-4ac7-a0da-8947c15bdaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.646981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c409c5-9d4f-4ac7-a0da-8947c15bdaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.647226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c409c5-9d4f-4ac7-a0da-8947c15bdaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.647864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c409c5-9d4f-4ac7-a0da-8947c15bdaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.649502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c409c5-9d4f-4ac7-a0da-8947c15bdaa1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.660241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1399/2797] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:29.664416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.674305 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ec2a-b32c-4a86-9a8f-60ff1304590f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.680259 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.680909 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.681239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.681502 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] PATH_INFO: `/v3/projects/c09a6ec62d994bdaa4b920aeaa23a32a/users/82d484e6ae834678867b5198d1e441a3/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.700779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09a6ec62d994bdaa4b920aeaa23a32a, user_id=82d484e6ae834678867b5198d1e441a3, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.704235 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.731313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1399/2798] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:29 2022] PUT /identity/v3/projects/c09a6ec62d994bdaa4b920aeaa23a32a/users/82d484e6ae834678867b5198d1e441a3/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:29.732816 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.733270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.733639 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.781592 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] MFA Rules not processed for user `82d484e6ae834678867b5198d1e441a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:29.782807 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:29.862834 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1400/2799] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:29.875552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:29.878120 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:29.947917 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726bee-f9d5-4ef9-a2d4-62fbccd97f81 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:29.951703 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d18e6612024b4cbef06e5da57d4bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:29.952299 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:29.952573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:29.952834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:29.961198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:29.962809 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:29.971522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1400/2800] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:31.085649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:31.087184 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:31.155209 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a7d3-8bb6-4a04-b51d-07c3b448aca8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:31.159364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:31.159987 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:31.160259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:31.160582 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:31.162516 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:31.229134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:31.230586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:31.241564 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1401/2801] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:32.315657 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:32.317406 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:32.350458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:32.378143 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a36d9b-a910-442e-be00-09f07dc756b6 service glance] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:32.381986 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:32.382577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:32.382839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:32.383082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:32.384834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:32.451192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:32.452572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb6fb-e3d7-4af6-bd97-85dc502757c0 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:32.462550 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1401/2802] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:33.397446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:33.399011 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:33.415085 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ed35-4f97-45b2-9e2f-072a212f050e service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:33.423472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:33.424190 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:33.424550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:33.424890 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] PATH_INFO: `/v3/users/d8736bcc51a54e5a813127ab0c78b25a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:33.426178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8736bcc51a54e5a813127ab0c78b25a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:33.428217 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:33.439875 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:33.491270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8736bcc51a54e5a813127ab0c78b25a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:33.503507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8736bcc51a54e5a813127ab0c78b25a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:33.518488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8736bcc51a54e5a813127ab0c78b25a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:33.519383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8736bcc51a54e5a813127ab0c78b25a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:33.521163 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8736bcc51a54e5a813127ab0c78b25a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:33.537519 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1402/2803] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:33 2022] DELETE /identity/v3/users/d8736bcc51a54e5a813127ab0c78b25a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:33.542113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:33.542600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:33.542700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:33.562289 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:33.563489 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:33.638263 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1402/2804] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:33.648081 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:33.649521 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:33.707062 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d681e-97c9-403d-9b3b-a3c864f9e7f3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:33.710670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:33.711276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:33.711550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:33.711817 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:33.725425 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:33.727094 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:33.739230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1403/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:34.140725 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:34.142354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:34.159054 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf2c2-5355-49f8-a256-0cc8e0f30553 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:34.164592 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:34.165695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:34.166767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:34.167363 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] PATH_INFO: `/v3/projects/184a76717d004a69bd18e2bb81b4b434` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:34.168539 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184a76717d004a69bd18e2bb81b4b434)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:34.170655 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:34.229978 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184a76717d004a69bd18e2bb81b4b434', 'request_id': 'req-0d608261-d5ed-438f-bd91-99489b0d6aa5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.244562 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184a76717d004a69bd18e2bb81b4b434', 'request_id': 'req-0d608261-d5ed-438f-bd91-99489b0d6aa5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.252308 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184a76717d004a69bd18e2bb81b4b434', 'request_id': 'req-0d608261-d5ed-438f-bd91-99489b0d6aa5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.261088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:34.266050 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] The token cache is being invalidate because project 184a76717d004a69bd18e2bb81b4b434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:34.266684 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.268017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.270093 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1403/2806] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:34 2022] DELETE /identity/v3/projects/184a76717d004a69bd18e2bb81b4b434 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:34.274194 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:34.284451 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8896b-68c7-4f50-b802-305724aaa5a1 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:34.357099 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:34.358257 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:34.358724 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:34.359225 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] PATH_INFO: `/v3/users/b8ca054817114f44b01f843be103d95b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:34.360611 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ca054817114f44b01f843be103d95b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:34.363340 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:34.427077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:34.450341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ca054817114f44b01f843be103d95b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.468747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ca054817114f44b01f843be103d95b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.481936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ca054817114f44b01f843be103d95b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.482664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ca054817114f44b01f843be103d95b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.483266 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ca054817114f44b01f843be103d95b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:34.500446 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1404/2807] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:34 2022] DELETE /identity/v3/users/b8ca054817114f44b01f843be103d95b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:34.802702 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:34.804177 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:34.843274 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d608261-d5ed-438f-bd91-99489b0d6aa5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:34.937794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:34.939765 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:34.940195 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:34.945800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] PATH_INFO: `/v3/projects/00be4c37bdbd4243b09a70cacd3a2469` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:34.951300 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=00be4c37bdbd4243b09a70cacd3a2469)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:34.953777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:35.014399 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00be4c37bdbd4243b09a70cacd3a2469', 'request_id': 'req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.022800 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00be4c37bdbd4243b09a70cacd3a2469', 'request_id': 'req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.030344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00be4c37bdbd4243b09a70cacd3a2469', 'request_id': 'req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.041295 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] The token cache is being invalidate because project 00be4c37bdbd4243b09a70cacd3a2469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:35.041581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.042296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.047600 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1404/2808] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:34 2022] DELETE /identity/v3/projects/00be4c37bdbd4243b09a70cacd3a2469 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:35.052105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:35.053857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:35.067598 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d254c-f53f-4a0c-bee7-31ac3526c954 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:35.153436 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:35.154078 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:35.154351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:35.154619 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] PATH_INFO: `/v3/users/c319d72f2b4542bb93a257cd46892cf8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:35.155730 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c319d72f2b4542bb93a257cd46892cf8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:35.157778 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:35.207696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c319d72f2b4542bb93a257cd46892cf8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.220113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c319d72f2b4542bb93a257cd46892cf8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.234295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c319d72f2b4542bb93a257cd46892cf8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.235016 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c319d72f2b4542bb93a257cd46892cf8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.235603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c319d72f2b4542bb93a257cd46892cf8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.248567 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1405/2809] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:35 2022] DELETE /identity/v3/users/c319d72f2b4542bb93a257cd46892cf8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:35.584689 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:35.585948 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:35.626442 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:35.627901 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:35.674721 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:35.712854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba41fbb-6846-4653-9d81-1ac30d1dc9ff admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:35.734578 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f73ee9-a318-41e2-9da6-9c0c20f12427 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:35.744676 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:35.746687 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:35.747379 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:35.747806 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] PATH_INFO: `/v3/projects/8e19870bdedd4ff0b4b317438f5c6c34` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:35.749849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e19870bdedd4ff0b4b317438f5c6c34)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:35.752572 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:35.770863 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:35.819940 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:35.820646 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:35.820747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:35.821017 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:35.822941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:35.834685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:35.836038 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e19870bdedd4ff0b4b317438f5c6c34', 'request_id': 'req-86c01d53-936e-46aa-8c86-0fabdc16c605'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.836288 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70ad18-1c7e-4fdc-9517-d2cb0e31c365 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:35.851839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1405/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:35.853816 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e19870bdedd4ff0b4b317438f5c6c34', 'request_id': 'req-86c01d53-936e-46aa-8c86-0fabdc16c605'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.864590 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e19870bdedd4ff0b4b317438f5c6c34', 'request_id': 'req-86c01d53-936e-46aa-8c86-0fabdc16c605'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.879259 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] The token cache is being invalidate because project 8e19870bdedd4ff0b4b317438f5c6c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:35.879595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.880274 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86c01d53-936e-46aa-8c86-0fabdc16c605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:35.888586 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1406/2811] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:35 2022] DELETE /identity/v3/projects/8e19870bdedd4ff0b4b317438f5c6c34 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:35.889269 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:35.889551 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:35.889895 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:35.912913 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:35.914201 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:35.976444 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1406/2812] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:35.985134 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:35.985414 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:35.985709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.007096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:36.008351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:36.017822 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1407/2813] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:36.022835 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.033234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2b4ea-bac1-4714-9c3e-ef7d23d786e0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.038537 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.039148 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.039420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.039683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.040324 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:36.040619 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.042398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.055499 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1407/2814] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:36.060068 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.070086 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be866d52-56da-4acf-abd7-a9cfd50757a5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.074800 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.075401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.075744 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.076006 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.076649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.078595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.112174 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1408/2815] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:36 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:36.120388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.133879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c532872-b2a4-4323-8037-18958e668c5e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.195803 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.196541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.196846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.197173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.197808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.199716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.221688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1408/2816] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:36 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:17:36.226037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.236805 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8693-a7d2-4ad1-8654-66e78c0af8eb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.242002 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.242634 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.242914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.243178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.243873 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.245579 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.258757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1409/2817] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:36.261192 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.274596 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8581f8-9249-44c1-9c7b-9b9e8f0ca844 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.280029 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc03f58-e756-4252-a3ee-8121947fe231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.280726 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03f58-e756-4252-a3ee-8121947fe231 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.281026 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03f58-e756-4252-a3ee-8121947fe231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.281306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03f58-e756-4252-a3ee-8121947fe231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.281945 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc03f58-e756-4252-a3ee-8121947fe231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.283572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc03f58-e756-4252-a3ee-8121947fe231 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.294524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1409/2818] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:36.298756 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.308760 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0a37-5080-4cbf-878d-c9058b9fc08e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.313246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.313889 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.314168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.314430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] PATH_INFO: `/v3/projects/80ca8faaa9834c09a4d0e7b9fd47c335/users/b8ac4d9825264caf9c96b3974276bb0f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.330845 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ca8faaa9834c09a4d0e7b9fd47c335, user_id=b8ac4d9825264caf9c96b3974276bb0f, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.333561 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.347649 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1410/2819] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:36 2022] PUT /identity/v3/projects/80ca8faaa9834c09a4d0e7b9fd47c335/users/b8ac4d9825264caf9c96b3974276bb0f/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:36.352767 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374a3f-a75f-4251-b4d7-0af8cb6838a0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.353156 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374a3f-a75f-4251-b4d7-0af8cb6838a0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.353432 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374a3f-a75f-4251-b4d7-0af8cb6838a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.373535 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-23374a3f-a75f-4251-b4d7-0af8cb6838a0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:36.374794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-23374a3f-a75f-4251-b4d7-0af8cb6838a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:36.401952 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:36.440554 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1410/2820] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:36.450500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:36.452288 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:36.508698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea0bae-83b6-47ed-82fc-60e6b83bad7b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:36.512608 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:36.513226 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:36.513510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:36.513846 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:36.523763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:36.525378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:36.529502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:36.537352 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1411/2821] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:37.248454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17f0a-60d8-42de-92c4-32ebacf21bbf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:37.249088 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17f0a-60d8-42de-92c4-32ebacf21bbf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:37.250756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17f0a-60d8-42de-92c4-32ebacf21bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:37.291839 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-93f17f0a-60d8-42de-92c4-32ebacf21bbf None None] MFA Rules not processed for user `b8ac4d9825264caf9c96b3974276bb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:37.294823 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-93f17f0a-60d8-42de-92c4-32ebacf21bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:37.383524 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1411/2822] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:37.395098 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:37.396498 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:37.484420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a2b4e-981a-42b4-8105-36fd3cbf51bf service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:37.490705 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:37.491464 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:37.491971 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:37.492334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:37.504703 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:37.507113 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:37.520709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1412/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:39.005543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:39.006431 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:39.006801 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:39.029194 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] MFA Rules not processed for user `b8ac4d9825264caf9c96b3974276bb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:39.030756 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:39.039580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1412/2824] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:39.451242 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:39.452907 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:39.471337 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4976-27d5-48f3-88ce-c308f3c376e0 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:39.476390 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:39.477070 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:39.477936 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:39.478219 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] PATH_INFO: `/v3/users/8025ccae0d3048e08b1b9e721321e0dd` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:39.479456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8025ccae0d3048e08b1b9e721321e0dd)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:39.481426 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:39.539698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8025ccae0d3048e08b1b9e721321e0dd'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.547510 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8025ccae0d3048e08b1b9e721321e0dd'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.559366 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8025ccae0d3048e08b1b9e721321e0dd'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.560014 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8025ccae0d3048e08b1b9e721321e0dd'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.560603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8025ccae0d3048e08b1b9e721321e0dd'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.574771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1413/2825] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:39 2022] DELETE /identity/v3/users/8025ccae0d3048e08b1b9e721321e0dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:39.794052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:39.805875 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87896db0-8519-46b4-8fbe-9aaabae218cd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:39.872226 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:39.872877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:39.873179 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:39.873495 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] PATH_INFO: `/v3/projects/68ab0ef7a44f48c3b62aba49743d1f8e` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:39.874743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ab0ef7a44f48c3b62aba49743d1f8e)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:39.876834 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:39.923747 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ab0ef7a44f48c3b62aba49743d1f8e', 'request_id': 'req-d291b4fb-d0da-40b0-8fc1-09daaf334438'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.927407 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:39.933197 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ab0ef7a44f48c3b62aba49743d1f8e', 'request_id': 'req-d291b4fb-d0da-40b0-8fc1-09daaf334438'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.941775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ab0ef7a44f48c3b62aba49743d1f8e', 'request_id': 'req-d291b4fb-d0da-40b0-8fc1-09daaf334438'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.953135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] The token cache is being invalidate because project 68ab0ef7a44f48c3b62aba49743d1f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:39.953351 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.953970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:39.955540 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1413/2826] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:39 2022] DELETE /identity/v3/projects/68ab0ef7a44f48c3b62aba49743d1f8e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:39.959776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:39.961351 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:39.980178 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b219d8-c327-4001-bd39-48aeeafe3927 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:40.045769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:40.047089 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:40.047357 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:40.047612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] PATH_INFO: `/v3/users/0e72db61678344b6921baaebba941f5f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:40.048940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e72db61678344b6921baaebba941f5f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:40.051143 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:40.065832 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:40.108828 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e72db61678344b6921baaebba941f5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.118410 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e72db61678344b6921baaebba941f5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.135064 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e72db61678344b6921baaebba941f5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.135809 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e72db61678344b6921baaebba941f5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.136402 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab95e4be-be3b-409d-ba60-6dec9867d39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e72db61678344b6921baaebba941f5f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.148747 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1414/2827] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:39 2022] DELETE /identity/v3/users/0e72db61678344b6921baaebba941f5f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:40.340152 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:40.341685 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:40.355018 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b4fb-d0da-40b0-8fc1-09daaf334438 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:40.410135 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:40.410769 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:40.411040 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:40.411306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] PATH_INFO: `/v3/projects/16cdb724b6194a4ba5361917a9233f59` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:40.412408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cdb724b6194a4ba5361917a9233f59)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:40.414344 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:40.468504 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cdb724b6194a4ba5361917a9233f59', 'request_id': 'req-fb5d4f2f-b3aa-4901-a567-28025eca13c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.478368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cdb724b6194a4ba5361917a9233f59', 'request_id': 'req-fb5d4f2f-b3aa-4901-a567-28025eca13c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.484877 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cdb724b6194a4ba5361917a9233f59', 'request_id': 'req-fb5d4f2f-b3aa-4901-a567-28025eca13c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.496428 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] The token cache is being invalidate because project 16cdb724b6194a4ba5361917a9233f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:40.496894 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.497643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:40.499249 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1414/2828] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:40 2022] DELETE /identity/v3/projects/16cdb724b6194a4ba5361917a9233f59 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:50.145336 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:50.493115 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:52.039383 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:52.039868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:52.039868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:52.060121 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] MFA Rules not processed for user `b8ac4d9825264caf9c96b3974276bb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:52.061344 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:52.121284 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1415/2829] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:52.358982 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:52.360716 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:52.421904 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4f2f-b3aa-4901-a567-28025eca13c4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:52.425850 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:52.426433 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:52.426700 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:52.426960 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:52.428688 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:52.438391 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:52.439810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de540-7182-4987-802d-ba9ac2f7c8f4 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:52.447887 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1415/2830] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:54.100748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:54.102323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:54.172661 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb86322-2cf6-487f-89b4-b6b789ef5291 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:54.177270 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:54.177914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:54.178377 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:54.178507 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] PATH_INFO: `/v3/users/82d484e6ae834678867b5198d1e441a3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:54.179559 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d484e6ae834678867b5198d1e441a3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:54.181637 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:54.231077 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d484e6ae834678867b5198d1e441a3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.240621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d484e6ae834678867b5198d1e441a3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.253456 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d484e6ae834678867b5198d1e441a3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.254150 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d484e6ae834678867b5198d1e441a3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.254879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d484e6ae834678867b5198d1e441a3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.267900 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1416/2831] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:54 2022] DELETE /identity/v3/users/82d484e6ae834678867b5198d1e441a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:54.272454 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:54.272953 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:54.273173 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:54.293919 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:54.295138 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:54.357001 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1416/2832] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:54.367253 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:54.368825 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:54.400679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:54.435438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a27e-2479-4562-9459-5c61a73d5a98 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:54.441132 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010303-d821-4ae2-8bef-0634fa36b32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:54.441745 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010303-d821-4ae2-8bef-0634fa36b32a service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:54.442037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010303-d821-4ae2-8bef-0634fa36b32a service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:54.442296 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010303-d821-4ae2-8bef-0634fa36b32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:54.451562 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010303-d821-4ae2-8bef-0634fa36b32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:54.453057 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010303-d821-4ae2-8bef-0634fa36b32a service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:54.462603 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1417/2833] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:54.738377 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:54.740114 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:54.757844 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812412-81d3-4747-8512-ea1aa6f37170 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:54.763048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:54.763867 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:54.764279 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:54.764628 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] PATH_INFO: `/v3/projects/c09a6ec62d994bdaa4b920aeaa23a32a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:54.766458 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09a6ec62d994bdaa4b920aeaa23a32a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:54.768579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:54.818111 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09a6ec62d994bdaa4b920aeaa23a32a', 'request_id': 'req-a2009249-5bfe-45fb-b35c-d034f6b49f80'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.827520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09a6ec62d994bdaa4b920aeaa23a32a', 'request_id': 'req-a2009249-5bfe-45fb-b35c-d034f6b49f80'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.834572 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09a6ec62d994bdaa4b920aeaa23a32a', 'request_id': 'req-a2009249-5bfe-45fb-b35c-d034f6b49f80'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.847033 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] The token cache is being invalidate because project c09a6ec62d994bdaa4b920aeaa23a32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:54.847328 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.847993 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a2009249-5bfe-45fb-b35c-d034f6b49f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:54.849777 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1417/2834] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:54 2022] DELETE /identity/v3/projects/c09a6ec62d994bdaa4b920aeaa23a32a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:54.854981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:54.855404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:54.855877 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:54.877091 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:54.878310 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:54.942580 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1418/2835] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:54.950786 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:54.951076 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:54.951338 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:54.976048 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:54.977313 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:54.985829 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1418/2836] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:54.990647 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.003343 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063afa-f63a-4838-b741-4fce162521a6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.009050 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.009773 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.010182 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.010536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.011309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:55.011697 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.013488 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.030896 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1419/2837] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:17:55.037125 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.047084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527458b3-0af3-411f-81d1-8581c5769e04 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.053774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.054376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.055103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.055358 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.056398 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.058910 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.086254 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:55.094914 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1419/2838] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:55.099155 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.109657 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831d09-c14f-4fc1-bbca-4795c78b9c90 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.181670 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.182370 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.182644 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.182910 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.183532 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.185648 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.208424 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1420/2839] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:55 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:55.212549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.222874 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bf954-b786-4922-a866-8f635d1e36c7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.227520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.228126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.228401 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.228668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.229340 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.230932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.241475 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1420/2840] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:55.245544 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.255898 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047de01-ffe8-4f8f-b8a5-76b1cd057050 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.260627 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7155-00ce-45d3-838c-151e31003278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.261260 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7155-00ce-45d3-838c-151e31003278 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.261536 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7155-00ce-45d3-838c-151e31003278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.261838 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7155-00ce-45d3-838c-151e31003278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.262482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c7155-00ce-45d3-838c-151e31003278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.264105 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c7155-00ce-45d3-838c-151e31003278 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.275737 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1421/2841] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:55.280352 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.290980 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa55d0-f522-41b1-aafb-f7b7d24d0c8e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.296462 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.297268 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.297547 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.297819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] PATH_INFO: `/v3/projects/2ff0fa0a5d3846159eef0811b8bdba02/users/ed535b02f2cd4b35a204116c03c07425/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.312712 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff0fa0a5d3846159eef0811b8bdba02, user_id=ed535b02f2cd4b35a204116c03c07425, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.315408 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.330206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1421/2842] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:55 2022] PUT /identity/v3/projects/2ff0fa0a5d3846159eef0811b8bdba02/users/ed535b02f2cd4b35a204116c03c07425/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:55.340633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.340914 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.341212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.368440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] MFA Rules not processed for user `ed535b02f2cd4b35a204116c03c07425`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:55.369570 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:55.389785 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:55.437043 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1422/2843] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:55.448368 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:55.450415 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:55.509261 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c18ff-f9a8-43d0-98e7-03f747e28782 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:55.513755 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094fb5-56f9-402a-a456-549bf1796187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:55.514397 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094fb5-56f9-402a-a456-549bf1796187 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:55.514668 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094fb5-56f9-402a-a456-549bf1796187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:55.514920 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094fb5-56f9-402a-a456-549bf1796187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:55.523275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094fb5-56f9-402a-a456-549bf1796187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:55.524705 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094fb5-56f9-402a-a456-549bf1796187 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:55.533549 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1422/2844] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:58.120036 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:58.188709 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab764c-f4ee-4319-98a1-8fe56e1317ea None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:58.193720 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:58.194353 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:58.194623 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:58.194891 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] PATH_INFO: `/v3/users/ed535b02f2cd4b35a204116c03c07425` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:58.196010 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed535b02f2cd4b35a204116c03c07425)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:58.197955 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:58.249496 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed535b02f2cd4b35a204116c03c07425'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.259037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed535b02f2cd4b35a204116c03c07425'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.272858 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed535b02f2cd4b35a204116c03c07425'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.273513 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed535b02f2cd4b35a204116c03c07425'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.274144 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed535b02f2cd4b35a204116c03c07425'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.287139 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1423/2845] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:17:58 2022] DELETE /identity/v3/users/ed535b02f2cd4b35a204116c03c07425 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:58.292174 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:58.292748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:58.292748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:58.311707 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:58.312902 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:58.373064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1423/2846] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:58.382871 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:58.384285 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:58.431119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:58.443419 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14265d80-177d-4daa-909a-9214a08924ce admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:58.447576 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7d26d-976a-4389-bb23-641bf1ffe518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:58.448203 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7d26d-976a-4389-bb23-641bf1ffe518 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:58.448472 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7d26d-976a-4389-bb23-641bf1ffe518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:58.448732 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7d26d-976a-4389-bb23-641bf1ffe518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:58.458876 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7d26d-976a-4389-bb23-641bf1ffe518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:58.460307 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7d26d-976a-4389-bb23-641bf1ffe518 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:58.469887 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1424/2847] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:58.760198 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:58.761866 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:58.774158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b35ce1-cba8-4c93-9f14-c90360062c2f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:58.779481 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:58.780136 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:58.780439 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:58.780706 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] PATH_INFO: `/v3/projects/2ff0fa0a5d3846159eef0811b8bdba02` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:58.782159 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff0fa0a5d3846159eef0811b8bdba02)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:58.784073 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:58.831232 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff0fa0a5d3846159eef0811b8bdba02', 'request_id': 'req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.840605 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff0fa0a5d3846159eef0811b8bdba02', 'request_id': 'req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.847081 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff0fa0a5d3846159eef0811b8bdba02', 'request_id': 'req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.848292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:58.860450 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] The token cache is being invalidate because project 2ff0fa0a5d3846159eef0811b8bdba02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:17:58.860695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.862266 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4c66464-45b7-4629-9e1c-3adb3bdf1dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:17:58.864242 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1424/2848] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:17:58 2022] DELETE /identity/v3/projects/2ff0fa0a5d3846159eef0811b8bdba02 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:17:58.869440 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:58.869717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:58.869984 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:58.890776 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:58.891974 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:58.956273 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1425/2849] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:58.964228 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:58.964510 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:58.964775 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:58.984449 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:58.985670 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:58.995472 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1425/2850] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:58.999749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.010404 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57831928-88f8-4e53-bf51-b32367af62e3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.016082 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.016665 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.016939 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.017246 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.017863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:17:59.018169 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.019811 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.031938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1426/2851] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:17:59.036207 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.045523 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80cfa-4a76-415a-9314-dc41e16a6892 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.050742 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.051325 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.051590 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.051873 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.052483 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.054389 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.083941 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1426/2852] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:17:59 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:59.088088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.102129 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac41ed-054b-465f-8951-5c3f77542ff0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.161309 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.161879 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.162175 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.162438 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.163056 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.164973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.188187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1427/2853] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:17:59 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:17:59.192456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.203104 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3670-940a-423d-9c26-775ec263a61f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.208676 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.209314 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.209583 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.209840 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.210468 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.212057 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.222103 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1427/2854] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:17:59.225787 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.235857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50165-d789-43f9-9ca3-3582d75fe3bd admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.241102 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a2ff-5ec6-429b-8979-45dbce51cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.241683 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a2ff-5ec6-429b-8979-45dbce51cc06 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.241956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a2ff-5ec6-429b-8979-45dbce51cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.242222 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a2ff-5ec6-429b-8979-45dbce51cc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.242851 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a2ff-5ec6-429b-8979-45dbce51cc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.244434 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a2ff-5ec6-429b-8979-45dbce51cc06 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.254920 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1428/2855] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:59.258979 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.268967 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c962f-84bb-4cd5-ba7d-668adf7faa8b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.273675 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.274306 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.274577 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.274841 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] PATH_INFO: `/v3/projects/21fd077db42d4552b1311e38943d9665/users/f12640ab0a524fd1b1f23e0ae6afb34b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.289916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fd077db42d4552b1311e38943d9665, user_id=f12640ab0a524fd1b1f23e0ae6afb34b, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.292519 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.307251 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1428/2856] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:17:59 2022] PUT /identity/v3/projects/21fd077db42d4552b1311e38943d9665/users/f12640ab0a524fd1b1f23e0ae6afb34b/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:17:59.317764 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af1d4-071d-43b7-af67-f4fdf999c662 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.318048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af1d4-071d-43b7-af67-f4fdf999c662 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.318306 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af1d4-071d-43b7-af67-f4fdf999c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.348863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-636af1d4-071d-43b7-af67-f4fdf999c662 None None] MFA Rules not processed for user `f12640ab0a524fd1b1f23e0ae6afb34b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:59.350088 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-636af1d4-071d-43b7-af67-f4fdf999c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:59.393698 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:59.419849 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1429/2857] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:59.431108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:59.433272 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:59.494541 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9e21-bbee-41fa-aa4a-4f4c332da2dd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:59.498452 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:59.499052 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:59.499319 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:59.499581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:59.508278 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:59.509764 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:59.518900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1429/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:18:08.099368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:08.099850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:08.099959 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:08.119815 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:08.121021 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:08.183408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1430/2859] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 10 11:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:08.233366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:08.234784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:08.302604 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd86101-774c-4908-ac9a-197a61d665df service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:08.307662 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d8c13-dda4-4a03-b846-43456685319d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:08.308253 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8c13-dda4-4a03-b846-43456685319d service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:08.308520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8c13-dda4-4a03-b846-43456685319d service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:08.308779 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8c13-dda4-4a03-b846-43456685319d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:08.317238 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d8c13-dda4-4a03-b846-43456685319d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:08.318794 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d8c13-dda4-4a03-b846-43456685319d service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:08.327748 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1430/2860] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:18:09.479465 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:09.551286 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc99330-734e-48d0-8932-209e97ae42a7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:09.556633 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:09.557312 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:09.557591 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:09.557861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] PATH_INFO: `/v3/users/f12640ab0a524fd1b1f23e0ae6afb34b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:09.558982 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12640ab0a524fd1b1f23e0ae6afb34b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:09.560915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:09.616481 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12640ab0a524fd1b1f23e0ae6afb34b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:09.626295 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12640ab0a524fd1b1f23e0ae6afb34b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:09.641290 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12640ab0a524fd1b1f23e0ae6afb34b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:09.642019 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12640ab0a524fd1b1f23e0ae6afb34b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:09.642803 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12640ab0a524fd1b1f23e0ae6afb34b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:09.657786 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1431/2861] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:18:09 2022] DELETE /identity/v3/users/f12640ab0a524fd1b1f23e0ae6afb34b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:18:09.662627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:09.663420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:09.663420 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:09.685492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:09.686879 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:09.701810 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:09.773258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1431/2862] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:18:09.784066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:09.785699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:09.793048 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:09.868283 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610766-08d9-438f-abf0-9bcf46082847 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:09.880430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f922c-3453-4c64-949a-9770ca1fc91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:09.881084 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f922c-3453-4c64-949a-9770ca1fc91a service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:09.881368 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f922c-3453-4c64-949a-9770ca1fc91a service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:09.881635 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f922c-3453-4c64-949a-9770ca1fc91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:09.893523 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f922c-3453-4c64-949a-9770ca1fc91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:09.895007 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f922c-3453-4c64-949a-9770ca1fc91a service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:09.906096 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1432/2863] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:18:10.279376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:10.281388 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:10.299240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912724-5a02-4cc9-8023-17ca0dc7e591 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:10.305545 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:10.306478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:10.306949 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:10.307403 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] PATH_INFO: `/v3/projects/21fd077db42d4552b1311e38943d9665` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:10.308790 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fd077db42d4552b1311e38943d9665)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:10.325182 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:10.385206 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fd077db42d4552b1311e38943d9665', 'request_id': 'req-f53698c3-4097-4300-bcb0-a24e941e249d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:10.396970 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fd077db42d4552b1311e38943d9665', 'request_id': 'req-f53698c3-4097-4300-bcb0-a24e941e249d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:10.410636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fd077db42d4552b1311e38943d9665', 'request_id': 'req-f53698c3-4097-4300-bcb0-a24e941e249d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:10.423956 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] The token cache is being invalidate because project 21fd077db42d4552b1311e38943d9665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:18:10.424490 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:10.425413 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:10.427245 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1432/2864] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:18:10 2022] DELETE /identity/v3/projects/21fd077db42d4552b1311e38943d9665 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:18:19.900830 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=24 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:20.420555 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:23.695769 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6006-d766-4118-b922-64d2786d736d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:23.696256 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6006-d766-4118-b922-64d2786d736d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:23.696363 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6006-d766-4118-b922-64d2786d736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:23.717319 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a98f6006-d766-4118-b922-64d2786d736d None None] MFA Rules not processed for user `55bc1cb8ee2a4dd3a47961c8189d2ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:23.718485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a98f6006-d766-4118-b922-64d2786d736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:23.776153 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1433/2865] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 10 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:23.788653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:23.790108 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:23.862717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53698c3-4097-4300-bcb0-a24e941e249d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:23.868366 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8553125282aa414db923858f1e27c76f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:23.868950 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:23.869257 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:23.869522 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:23.878660 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:23.880215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:23.888097 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1433/2866] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 10 11:18:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:18:25.859844 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f6006-d766-4118-b922-64d2786d736d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:25.861334 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a98f6006-d766-4118-b922-64d2786d736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:25.928500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f6006-d766-4118-b922-64d2786d736d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:25.932848 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:25.933506 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:25.933748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:25.934008 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] PATH_INFO: `/v3/users/b8ac4d9825264caf9c96b3974276bb0f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:25.935116 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ac4d9825264caf9c96b3974276bb0f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:25.937022 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:25.985746 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ac4d9825264caf9c96b3974276bb0f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:25.994915 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ac4d9825264caf9c96b3974276bb0f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.007239 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ac4d9825264caf9c96b3974276bb0f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.007922 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ac4d9825264caf9c96b3974276bb0f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.008550 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f81de74-1293-40c4-8332-cf908c29d65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ac4d9825264caf9c96b3974276bb0f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.020455 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1434/2867] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:18:25 2022] DELETE /identity/v3/users/b8ac4d9825264caf9c96b3974276bb0f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:18:26.198638 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.209672 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416787e9-2d4c-4720-aff1-a8d33397c685 service swift] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.272636 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.273292 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.273560 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.273822 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] PATH_INFO: `/v3/projects/80ca8faaa9834c09a4d0e7b9fd47c335` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.274916 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ca8faaa9834c09a4d0e7b9fd47c335)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.276808 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.330030 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ca8faaa9834c09a4d0e7b9fd47c335', 'request_id': 'req-d11075b5-ef45-4a18-a46a-febbda0f0163'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.339296 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ca8faaa9834c09a4d0e7b9fd47c335', 'request_id': 'req-d11075b5-ef45-4a18-a46a-febbda0f0163'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.345501 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ca8faaa9834c09a4d0e7b9fd47c335', 'request_id': 'req-d11075b5-ef45-4a18-a46a-febbda0f0163'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.355739 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] The token cache is being invalidate because project 80ca8faaa9834c09a4d0e7b9fd47c335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:18:26.356020 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.356677 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d11075b5-ef45-4a18-a46a-febbda0f0163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:26.358170 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1434/2868] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:18:26 2022] DELETE /identity/v3/projects/80ca8faaa9834c09a4d0e7b9fd47c335 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:18:26.363658 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.363938 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.364212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.383420 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:26.384605 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:26.403382 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:26.447408 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1435/2869] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:26.455199 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.455478 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.455770 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.475484 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:26.476671 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:26.484858 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1435/2870] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:26.490026 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.504482 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa032a9-50e6-4bfd-9c65-7be82cf45969 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.512864 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.513707 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.514075 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.514435 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.515376 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:18:26.515728 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.518241 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.530199 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1436/2871] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 10 11:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:18:26.534580 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.543749 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b9634-8de3-4cfc-be6a-0dba28df317c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.548740 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.549355 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.549625 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.549965 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.550586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.552498 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.563586 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:26.584846 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1436/2872] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 10 11:18:26 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:18:26.588995 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.598956 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134eed7-9bf1-4019-af52-febb0cc304af admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.654327 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.654913 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.655171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.655432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.656037 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.658118 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.680861 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1437/2873] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 10 11:18:26 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:18:26.685084 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.695563 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92243d3-9a67-4e8b-97a3-a489a507859e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.700405 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.700929 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.701240 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.701492 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.702126 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.703711 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.713639 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1437/2874] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:18:26.717686 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.728157 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6435b-9007-495a-bd98-b209c0396a72 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.733430 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76e77-264b-4f47-98a6-218232bf0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.734018 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76e77-264b-4f47-98a6-218232bf0b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.734347 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76e77-264b-4f47-98a6-218232bf0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.734631 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76e77-264b-4f47-98a6-218232bf0b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.735244 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb76e77-264b-4f47-98a6-218232bf0b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.736857 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb76e77-264b-4f47-98a6-218232bf0b32 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.748367 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1438/2875] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 10 11:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:18:26.752900 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.762724 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe21d-9427-4056-bbbd-29245af0b97d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.767699 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.768349 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.768602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.768870 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] PATH_INFO: `/v3/projects/000afb54e2204530821737482adc8eb7/users/ab6614112a0a46b19f9fbc2051783d44/roles/bfca7dcaa6ab42089f5b35de5ab9a97a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.784446 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] RBAC: Authorizing `identity:create_grant(project_id=000afb54e2204530821737482adc8eb7, user_id=ab6614112a0a46b19f9fbc2051783d44, role_id=bfca7dcaa6ab42089f5b35de5ab9a97a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.787139 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.802064 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1438/2876] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 10 11:18:26 2022] PUT /identity/v3/projects/000afb54e2204530821737482adc8eb7/users/ab6614112a0a46b19f9fbc2051783d44/roles/bfca7dcaa6ab42089f5b35de5ab9a97a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:18:26.807168 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3b09e-9049-4c40-847b-cdb407a25f49 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.807448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3b09e-9049-4c40-847b-cdb407a25f49 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.807717 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3b09e-9049-4c40-847b-cdb407a25f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.826595 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3ed3b09e-9049-4c40-847b-cdb407a25f49 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:26.827818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3ed3b09e-9049-4c40-847b-cdb407a25f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:26.888055 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1439/2877] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:26.898027 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:26.899718 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:26.958627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b81e-07ed-4bc6-a726-ebaa3723411f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:26.963215 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef62b1004224069a326d0ce684e9307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:26.963819 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:26.964083 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:26.964337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:26.974275 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:26.975704 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:26.984994 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1439/2878] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:18:27.627642 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881c62b-71fd-4205-91e2-f0c70141de66 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:27.628049 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881c62b-71fd-4205-91e2-f0c70141de66 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:27.628320 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881c62b-71fd-4205-91e2-f0c70141de66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:27.658416 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f881c62b-71fd-4205-91e2-f0c70141de66 None None] MFA Rules not processed for user `ab6614112a0a46b19f9fbc2051783d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:27.659779 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f881c62b-71fd-4205-91e2-f0c70141de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:27.679314 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:27.729767 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1440/2879] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:27.741611 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:27.743234 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:27.800566 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd289a-cf45-40e3-816a-45de729a0e72 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:27.804456 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823c7c6-d327-43ff-ad2b-07574857a37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1604862a92742d8bd8d1ca837a63c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:27.805082 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823c7c6-d327-43ff-ad2b-07574857a37d service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:27.805350 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823c7c6-d327-43ff-ad2b-07574857a37d service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:27.805608 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823c7c6-d327-43ff-ad2b-07574857a37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:27.813890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823c7c6-d327-43ff-ad2b-07574857a37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:27.815329 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823c7c6-d327-43ff-ad2b-07574857a37d service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:27.823885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1440/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:18:29.206966 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:29.207539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:29.207539 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:29.233958 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] MFA Rules not processed for user `ab6614112a0a46b19f9fbc2051783d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:29.235749 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:29.243996 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1441/2881] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:37.820395 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:39.223906 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=21 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:55.479964 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93044-e489-4670-8044-5287d6c76d9f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:55.480581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93044-e489-4670-8044-5287d6c76d9f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:55.480581 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93044-e489-4670-8044-5287d6c76d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:55.571865 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-37b93044-e489-4670-8044-5287d6c76d9f None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:55.573147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-37b93044-e489-4670-8044-5287d6c76d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:55.632579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1441/2882] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:55.682500 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:55.684780 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:55.835888 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0f1ea-014c-45f8-9b21-68eba38330d1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:55.842757 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:55.843362 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:55.843630 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:55.843893 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:55.852897 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:55.854502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:55.864946 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1442/2883] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:18:58.587784 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea4ee-a941-4590-9708-adf57b11610b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.588376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea4ee-a941-4590-9708-adf57b11610b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.588376 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea4ee-a941-4590-9708-adf57b11610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.608868 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-04fea4ee-a941-4590-9708-adf57b11610b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:58.610113 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-04fea4ee-a941-4590-9708-adf57b11610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.619354 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1442/2884] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:58.634771 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:58.637148 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.652768 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522296f6-803e-4aed-a5c1-5d14afd6d85e service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:58.659886 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:58.660475 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.660748 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.661013 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.669868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:58.671444 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:58.681189 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1443/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:01.891375 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16927e-4139-4b52-b984-123020170ac0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:01.891958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16927e-4139-4b52-b984-123020170ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:01.891958 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16927e-4139-4b52-b984-123020170ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:01.916004 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6e16927e-4139-4b52-b984-123020170ac0 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:01.917239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6e16927e-4139-4b52-b984-123020170ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:01.926602 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1443/2886] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:01.942504 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:01.953880 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b013f46-72b3-4920-95ad-a9662ae43269 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:01.960546 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:01.961187 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:01.961447 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:01.961708 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:01.970303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:01.971908 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:01.981401 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1444/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:04.972520 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bbc12-0329-4092-8939-468c3d226a2d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:04.973063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bbc12-0329-4092-8939-468c3d226a2d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:04.973063 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bbc12-0329-4092-8939-468c3d226a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:04.993416 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8b0bbc12-0329-4092-8939-468c3d226a2d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:04.994627 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8b0bbc12-0329-4092-8939-468c3d226a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:05.002999 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1444/2888] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:05.023612 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:05.034954 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e006eef-3e7b-451c-a27e-eba05a17cabb service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:05.040722 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:05.041341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:05.041601 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:05.041884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:05.050664 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:05.052269 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:05.062679 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1445/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:08.213890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9c1d-3adc-4ae8-820e-798e3751385b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:08.214693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9c1d-3adc-4ae8-820e-798e3751385b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:08.214693 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9c1d-3adc-4ae8-820e-798e3751385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:08.244312 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-198f9c1d-3adc-4ae8-820e-798e3751385b None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:08.245543 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-198f9c1d-3adc-4ae8-820e-798e3751385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:08.254796 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1445/2890] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:08.272763 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:08.287940 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aace2b9-a9ea-423a-b06a-9094e0b2ce7a service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:08.295223 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:08.295884 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:08.296076 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:08.296364 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:08.305303 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:08.306941 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:08.317095 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1446/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:11.347102 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:11.347673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:11.347673 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:11.368364 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:11.369575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:11.378818 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1446/2892] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:11.399035 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:11.414100 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5d69-a300-4729-b9fc-75d49aae7dd3 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:11.421066 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f76b6d-8529-4a9a-ab28-5f51064d719d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:11.421677 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76b6d-8529-4a9a-ab28-5f51064d719d service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:11.421951 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76b6d-8529-4a9a-ab28-5f51064d719d service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:11.422212 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76b6d-8529-4a9a-ab28-5f51064d719d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:11.431378 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f76b6d-8529-4a9a-ab28-5f51064d719d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:11.433003 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f76b6d-8529-4a9a-ab28-5f51064d719d service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:11.445609 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1447/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:21.363041 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=60 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:21.439932 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:21.673526 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:21.674991 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:21.776258 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35961bc2-bfda-4bf4-9009-30ab16c111ae None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:21.782117 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:21.783051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:21.783051 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:21.783291 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:21.785147 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:21.797231 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:21.798778 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc401589-bf06-4702-b41e-ba8a638a6b94 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:21.809065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1447/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:26.605092 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:26.605615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:26.605615 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:26.627989 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] MFA Rules not processed for user `ab6614112a0a46b19f9fbc2051783d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:26.629237 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:26.637301 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1448/2895] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 10 11:19:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:31.804816 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=41 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:36.623197 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:37.235899 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec7d4-ef58-4d91-aa27-3385eb7110e7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:37.236772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec7d4-ef58-4d91-aa27-3385eb7110e7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:37.236772 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec7d4-ef58-4d91-aa27-3385eb7110e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:37.260133 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b84ec7d4-ef58-4d91-aa27-3385eb7110e7 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:37.260932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b84ec7d4-ef58-4d91-aa27-3385eb7110e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:37.270151 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1448/2896] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:37.304926 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:37.321220 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58486d08-c6f8-46f7-a33b-cb9c56592b65 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:37.327645 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:37.328245 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:37.328520 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:37.328784 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:37.337119 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:37.338699 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:37.348138 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1449/2897] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:40.514575 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e03cac-f976-4c9b-b10a-d70924ed87ae None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:40.515112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e03cac-f976-4c9b-b10a-d70924ed87ae None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:40.515112 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e03cac-f976-4c9b-b10a-d70924ed87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:40.535653 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e3e03cac-f976-4c9b-b10a-d70924ed87ae None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:40.536845 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e3e03cac-f976-4c9b-b10a-d70924ed87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:40.545854 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1449/2898] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:40.583317 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:40.595868 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592cbe-a206-4ee8-8048-6845524d7904 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:40.601557 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:40.602151 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:40.602448 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:40.602723 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:40.611863 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:40.613548 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:40.623514 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1450/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:43.575807 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f649f-4a38-4fec-b831-b9502dca655d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:43.576322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f649f-4a38-4fec-b831-b9502dca655d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:43.576322 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f649f-4a38-4fec-b831-b9502dca655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:43.596631 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f73f649f-4a38-4fec-b831-b9502dca655d None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:43.597860 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f73f649f-4a38-4fec-b831-b9502dca655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:43.607557 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1450/2900] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:43.625818 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:43.637600 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82a0f-dfc4-4baa-9ba0-a16730525108 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:43.645065 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:43.645696 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:43.645973 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:43.646257 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:43.654839 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:43.656449 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:43.666341 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1451/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:46.766202 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338f55-9acb-4392-a122-2036b9fa6273 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:46.766695 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338f55-9acb-4392-a122-2036b9fa6273 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:46.766804 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338f55-9acb-4392-a122-2036b9fa6273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:46.786045 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-95338f55-9acb-4392-a122-2036b9fa6273 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:46.787239 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-95338f55-9acb-4392-a122-2036b9fa6273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:46.795743 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1451/2902] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:46.813323 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:46.834195 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddf2a6-359c-4c5f-a9a9-afbef7022259 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:46.841358 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:46.841992 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:46.842263 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:46.842526 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:46.852348 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:46.853970 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:46.865297 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1452/2903] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:49.996419 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:49.996961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:49.996961 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:50.017579 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] MFA Rules not processed for user `e2ef5869bc0645f193056c60370729ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:19:50.018766 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:50.027885 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1452/2904] 10.222.0.44 () {58 vars in 1016 bytes} [Wed Aug 10 11:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:19:50.065584 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:50.077308 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1be9-673c-446a-912a-2ea5fe63dc3e service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:50.084204 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8e23edf404c378eba94e917be0c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:50.084850 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:50.085171 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:50.085432 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:50.093993 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:50.095577 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:50.105678 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1453/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:00.011890 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=15 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:00.101276 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=30 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:19.402774 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:19.413285 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e5b3-0a7a-4d3f-a436-414aec528b86 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:19.418683 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:19.419337 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:19.419607 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:19.419932 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] PATH_INFO: `/v3/users/ab6614112a0a46b19f9fbc2051783d44` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:19.421298 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6614112a0a46b19f9fbc2051783d44)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:19.423241 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:19.471787 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6614112a0a46b19f9fbc2051783d44'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.484326 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6614112a0a46b19f9fbc2051783d44'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.491564 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6614112a0a46b19f9fbc2051783d44'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.492438 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6614112a0a46b19f9fbc2051783d44'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.493372 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6614112a0a46b19f9fbc2051783d44'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.509065 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1453/2906] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 10 11:20:19 2022] DELETE /identity/v3/users/ab6614112a0a46b19f9fbc2051783d44 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:20:19.687735 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:19.702230 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec969-c969-4f72-b110-246fa9be7b78 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:19.760205 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ef5869bc0645f193056c60370729ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65fdb45b0c1547cc9b08e89b6225a55f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:19.760833 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:19.761141 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:19.761411 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] PATH_INFO: `/v3/projects/000afb54e2204530821737482adc8eb7` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:19.762573 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000afb54e2204530821737482adc8eb7)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:19.764485 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:19.815012 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000afb54e2204530821737482adc8eb7', 'request_id': 'req-5d819ad2-3a64-4fb5-997e-76354175c1a5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.821738 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000afb54e2204530821737482adc8eb7', 'request_id': 'req-5d819ad2-3a64-4fb5-997e-76354175c1a5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.831027 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000afb54e2204530821737482adc8eb7', 'request_id': 'req-5d819ad2-3a64-4fb5-997e-76354175c1a5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.841621 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] The token cache is being invalidate because project 000afb54e2204530821737482adc8eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:20:19.841903 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.842502 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5d819ad2-3a64-4fb5-997e-76354175c1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:20:19.843981 dv-cinder-850618-2-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1454/2907] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 10 11:20:19 2022] DELETE /identity/v3/projects/000afb54e2204530821737482adc8eb7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:20:29.505717 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:29.839005 dv-cinder-850618-2-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:45.824046 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:45.825643 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:45.900218 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e3c70-5ed6-41a8-adc2-6ee373d899f2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:45.958552 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd9a24c27d14095b4a7d1cbd538d34c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264aaf5f81114cd7a530cc98eadcf269', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:45.959157 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:45.959425 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:45.959687 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:45.961612 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:45.973573 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:45.975158 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22446a2d-2800-43a3-887c-c32c8b7e744f service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:45.985710 dv-cinder-850618-2-smb devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1454/2908] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:55.981610 dv-cinder-850618-2-smb devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=58 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}